2026-03-28 21:05:04 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 21:05:04 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 21:05:04 [auto1.it] INFO: Batch mode enabled: batch 2/2
2026-03-28 21:05:04 [auto1.it] INFO: Starting spider auto1.it
2026-03-28 21:05:04 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 21:05:04 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 21:05:04 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 21:05:04 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 21:05:04 [scrapy.extensions.telnet] INFO: Telnet Password: 463e84517d70e6da
2026-03-28 21:05:04 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-28 21:05:04 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.it/task_23_2026-03-28T21_05_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-28 21:05:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 21:05:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 21:05:04 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 21:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 21:05:04 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 21:05:04 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-28 21:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 21:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2121
2026-03-28 21:05:05 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 21:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 21:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:05 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 21:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 21:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 21:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 21:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 21:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 21:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 21:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 21:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 21:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 21:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 21:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 21:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 21:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 21:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 21:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 21:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 21:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 21:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 21:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 21:05:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 21:05:05 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 21:05:05 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 21:05:05 [scrapy.core.engine] INFO: Spider opened
2026-03-28 21:05:05 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 21:05:05 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-28 21:05:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-28 21:05:05 [scrapy-playwright] INFO: Starting download handler
2026-03-28 21:05:05 [scrapy-playwright] INFO: Starting download handler
2026-03-28 21:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 21:05:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 21:05:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 21:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 21:05:14 [auto1.it] INFO: Channel: 24h | Page: 0 | totalHits: 2224 | hits on page: 40
2026-03-28 21:05:14 [auto1.it] INFO: Found listing with ID: DT89557
2026-03-28 21:05:14 [auto1.it] INFO: Found listing with ID: VK83291
2026-03-28 21:05:14 [auto1.it] INFO: Found listing with ID: FR55609
2026-03-28 21:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR55609%27 HTTP/1.1" 200 None
2026-03-28 21:05:14 [auto1.it] INFO: Scrape type for FR55609: 0
2026-03-28 21:05:14 [auto1.it] INFO: Found listing with ID: CV87912
2026-03-28 21:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV87912%27 HTTP/1.1" 200 None
2026-03-28 21:05:14 [auto1.it] INFO: Scrape type for CV87912: 0
2026-03-28 21:05:14 [auto1.it] INFO: Found listing with ID: MU13564
2026-03-28 21:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU13564%27 HTTP/1.1" 200 None
2026-03-28 21:05:14 [auto1.it] INFO: Scrape type for MU13564: 0
2026-03-28 21:05:14 [auto1.it] INFO: Found listing with ID: PY58212
2026-03-28 21:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY58212%27 HTTP/1.1" 200 None
2026-03-28 21:05:14 [auto1.it] INFO: Scrape type for PY58212: 0
2026-03-28 21:05:14 [auto1.it] INFO: Found listing with ID: NX47141
2026-03-28 21:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX47141%27 HTTP/1.1" 200 None
2026-03-28 21:05:14 [auto1.it] INFO: Scrape type for NX47141: 0
2026-03-28 21:05:14 [auto1.it] INFO: Found listing with ID: SC24235
2026-03-28 21:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC24235%27 HTTP/1.1" 200 None
2026-03-28 21:05:14 [auto1.it] INFO: Scrape type for SC24235: 0
2026-03-28 21:05:14 [auto1.it] INFO: Found listing with ID: WL97433
2026-03-28 21:05:14 [auto1.it] INFO: Found listing with ID: NL26741
2026-03-28 21:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL26741%27 HTTP/1.1" 200 None
2026-03-28 21:05:14 [auto1.it] INFO: Scrape type for NL26741: 0
2026-03-28 21:05:14 [auto1.it] INFO: Found listing with ID: CR51689
2026-03-28 21:05:14 [auto1.it] INFO: Found listing with ID: PE19282
2026-03-28 21:05:14 [auto1.it] INFO: Found listing with ID: LP93747
2026-03-28 21:05:14 [auto1.it] INFO: Found listing with ID: RA56260
2026-03-28 21:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA56260%27 HTTP/1.1" 200 None
2026-03-28 21:05:14 [auto1.it] INFO: Scrape type for RA56260: 1
2026-03-28 21:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:14 [auto1.it] INFO: Found listing with ID: EK01014
2026-03-28 21:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK01014%27 HTTP/1.1" 200 None
2026-03-28 21:05:14 [auto1.it] INFO: Scrape type for EK01014: 1
2026-03-28 21:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:14 [auto1.it] INFO: Found listing with ID: ZH89782
2026-03-28 21:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH89782%27 HTTP/1.1" 200 None
2026-03-28 21:05:14 [auto1.it] INFO: Scrape type for ZH89782: 2
2026-03-28 21:05:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7afea1e8-2845-526a-8974-b14fa96dfdb6 with identifier: ZH89782
2026-03-28 21:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7afea1e8-2845-526a-8974-b14fa96dfdb6 with scrape type 2
2026-03-28 21:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7afea1e8-2845-526a-8974-b14fa96dfdb6 with scrape type 2
2026-03-28 21:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7afea1e8-2845-526a-8974-b14fa96dfdb6, identifier: ZH89782
2026-03-28 21:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7afea1e8-2845-526a-8974-b14fa96dfdb6 with identifier: ZH89782
2026-03-28 21:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 21:05:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 21:05:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 21:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 21:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 21:05:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 21:05:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 21:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 21:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7afea1e8-2845-526a-8974-b14fa96dfdb6 with identifier: ZH89782
2026-03-28 21:05:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7afea1e8-2845-526a-8974-b14fa96dfdb6 with identifier: ZH89782 to the API
2026-03-28 21:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:01:17Z',
'fuel_type': 'diesel',
'id': '7afea1e8-2845-526a-8974-b14fa96dfdb6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH89782',
'listing': 'auction',
'make': 'Chevrolet',
'model': 'Captiva',
'odometer': 113583,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-02-28',
'seller_name': None,
'title': 'Chevrolet Captiva 2.0 Diesel D LT 4WD Exclusive',
'transmission': 'manual',
'trim': 'D LT 4WD Exclusive',
'year': 2007}
2026-03-28 21:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH89782%27 HTTP/1.1" 200 None
2026-03-28 21:05:16 [auto1.it] INFO: Saving data for ZH89782: {'auction_closing_time': 1774882877.0, 'created_time': 1774343249.96486, 'last_price_update_time': 1774731916.34825}
2026-03-28 21:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZH89782') HTTP/1.1" 204 0
2026-03-28 21:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:16 [auto1.it] INFO: Found listing with ID: YS46644
2026-03-28 21:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS46644%27 HTTP/1.1" 200 None
2026-03-28 21:05:16 [auto1.it] INFO: Scrape type for YS46644: 1
2026-03-28 21:05:16 [auto1.it] INFO: Found listing with ID: RC57618
2026-03-28 21:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC57618%27 HTTP/1.1" 200 None
2026-03-28 21:05:16 [auto1.it] INFO: Scrape type for RC57618: 1
2026-03-28 21:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:16 [auto1.it] INFO: Found listing with ID: RZ13611
2026-03-28 21:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ13611%27 HTTP/1.1" 200 None
2026-03-28 21:05:16 [auto1.it] INFO: Scrape type for RZ13611: 1
2026-03-28 21:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:16 [auto1.it] INFO: Found listing with ID: TD94995
2026-03-28 21:05:16 [auto1.it] INFO: Found listing with ID: EW86248
2026-03-28 21:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW86248%27 HTTP/1.1" 200 None
2026-03-28 21:05:16 [auto1.it] INFO: Scrape type for EW86248: 2
2026-03-28 21:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf6bd88a-c047-5edd-97de-6c7d3e2409b0 with identifier: EW86248
2026-03-28 21:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf6bd88a-c047-5edd-97de-6c7d3e2409b0 with scrape type 2
2026-03-28 21:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf6bd88a-c047-5edd-97de-6c7d3e2409b0 with scrape type 2
2026-03-28 21:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bf6bd88a-c047-5edd-97de-6c7d3e2409b0, identifier: EW86248
2026-03-28 21:05:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bf6bd88a-c047-5edd-97de-6c7d3e2409b0 with identifier: EW86248
2026-03-28 21:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bf6bd88a-c047-5edd-97de-6c7d3e2409b0 with identifier: EW86248
2026-03-28 21:05:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bf6bd88a-c047-5edd-97de-6c7d3e2409b0 with identifier: EW86248 to the API
2026-03-28 21:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:04:53Z',
'fuel_type': 'diesel',
'id': 'bf6bd88a-c047-5edd-97de-6c7d3e2409b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW86248',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 129398,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-13',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Urban',
'transmission': 'automatic',
'trim': 'BlueEfficiency Urban',
'year': 2013}
2026-03-28 21:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW86248%27 HTTP/1.1" 200 None
2026-03-28 21:05:17 [auto1.it] INFO: Saving data for EW86248: {'auction_closing_time': 1774883093.0, 'created_time': 1774343228.215222, 'last_price_update_time': 1774731917.000812}
2026-03-28 21:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EW86248') HTTP/1.1" 204 0
2026-03-28 21:05:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:17 [auto1.it] INFO: Found listing with ID: WB67715
2026-03-28 21:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB67715%27 HTTP/1.1" 200 None
2026-03-28 21:05:17 [auto1.it] INFO: Scrape type for WB67715: 2
2026-03-28 21:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2c60001-9b5f-5e89-bafc-a84bccb15a7e with identifier: WB67715
2026-03-28 21:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2c60001-9b5f-5e89-bafc-a84bccb15a7e with scrape type 2
2026-03-28 21:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2c60001-9b5f-5e89-bafc-a84bccb15a7e with scrape type 2
2026-03-28 21:05:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b2c60001-9b5f-5e89-bafc-a84bccb15a7e, identifier: WB67715
2026-03-28 21:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b2c60001-9b5f-5e89-bafc-a84bccb15a7e with identifier: WB67715
2026-03-28 21:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 21:05:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-28 21:05:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 21:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 21:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b2c60001-9b5f-5e89-bafc-a84bccb15a7e with identifier: WB67715
2026-03-28 21:05:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b2c60001-9b5f-5e89-bafc-a84bccb15a7e with identifier: WB67715 to the API
2026-03-28 21:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:54:03Z',
'fuel_type': 'diesel',
'id': 'b2c60001-9b5f-5e89-bafc-a84bccb15a7e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB67715',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 142334,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-02',
'seller_name': None,
'title': 'Peugeot 308 1.6 e-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2014}
2026-03-28 21:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB67715%27 HTTP/1.1" 200 None
2026-03-28 21:05:17 [auto1.it] INFO: Saving data for WB67715: {'auction_closing_time': 1774886043.0, 'created_time': 1774343248.63214, 'last_price_update_time': 1774731917.580617}
2026-03-28 21:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WB67715') HTTP/1.1" 204 0
2026-03-28 21:05:17 [auto1.it] INFO: Found listing with ID: ZK23412
2026-03-28 21:05:17 [auto1.it] INFO: Found listing with ID: KT97112
2026-03-28 21:05:17 [auto1.it] INFO: Found listing with ID: VX54409
2026-03-28 21:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX54409%27 HTTP/1.1" 200 None
2026-03-28 21:05:17 [auto1.it] INFO: Scrape type for VX54409: 1
2026-03-28 21:05:17 [auto1.it] INFO: Found listing with ID: XH11814
2026-03-28 21:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH11814%27 HTTP/1.1" 200 None
2026-03-28 21:05:17 [auto1.it] INFO: Scrape type for XH11814: 1
2026-03-28 21:05:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:17 [auto1.it] INFO: Found listing with ID: KN64287
2026-03-28 21:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KN64287%27 HTTP/1.1" 200 None
2026-03-28 21:05:17 [auto1.it] INFO: Scrape type for KN64287: 1
2026-03-28 21:05:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:17 [auto1.it] INFO: Found listing with ID: JM92552
2026-03-28 21:05:17 [auto1.it] INFO: Found listing with ID: HP20595
2026-03-28 21:05:17 [auto1.it] INFO: Found listing with ID: RF53509
2026-03-28 21:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF53509%27 HTTP/1.1" 200 None
2026-03-28 21:05:17 [auto1.it] INFO: Scrape type for RF53509: 1
2026-03-28 21:05:17 [auto1.it] INFO: Found listing with ID: VY56093
2026-03-28 21:05:17 [auto1.it] INFO: Found listing with ID: XS81991
2026-03-28 21:05:17 [auto1.it] INFO: Found listing with ID: KL09391
2026-03-28 21:05:17 [auto1.it] INFO: Found listing with ID: DH11119
2026-03-28 21:05:17 [auto1.it] INFO: Found listing with ID: VL58331
2026-03-28 21:05:17 [auto1.it] INFO: Found listing with ID: MW24611
2026-03-28 21:05:17 [auto1.it] INFO: Found listing with ID: WJ42513
2026-03-28 21:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ42513%27 HTTP/1.1" 200 None
2026-03-28 21:05:17 [auto1.it] INFO: Scrape type for WJ42513: 1
2026-03-28 21:05:17 [auto1.it] INFO: Found listing with ID: RX80413
2026-03-28 21:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX80413%27 HTTP/1.1" 200 None
2026-03-28 21:05:17 [auto1.it] INFO: Scrape type for RX80413: 1
2026-03-28 21:05:17 [auto1.it] INFO: Found listing with ID: JK04484
2026-03-28 21:05:17 [auto1.it] INFO: Found listing with ID: ZE02722
2026-03-28 21:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE02722%27 HTTP/1.1" 200 None
2026-03-28 21:05:17 [auto1.it] INFO: Scrape type for ZE02722: 1
2026-03-28 21:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RC57618/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YS46644/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XH11814/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VX54409/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:18 [auto1.it] INFO: Channel: 24h | Page: 1 | totalHits: 2224 | hits on page: 40
2026-03-28 21:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RZ13611/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RA56260/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:18 [auto1.it] INFO: Found listing with ID: DT89557
2026-03-28 21:05:18 [auto1.it] INFO: Found listing with ID: VK83291
2026-03-28 21:05:18 [auto1.it] INFO: Found listing with ID: FR55609
2026-03-28 21:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR55609%27 HTTP/1.1" 200 None
2026-03-28 21:05:18 [auto1.it] INFO: Scrape type for FR55609: 0
2026-03-28 21:05:18 [auto1.it] INFO: Found listing with ID: CV87912
2026-03-28 21:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV87912%27 HTTP/1.1" 200 None
2026-03-28 21:05:18 [auto1.it] INFO: Scrape type for CV87912: 0
2026-03-28 21:05:18 [auto1.it] INFO: Found listing with ID: MU13564
2026-03-28 21:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU13564%27 HTTP/1.1" 200 None
2026-03-28 21:05:18 [auto1.it] INFO: Scrape type for MU13564: 0
2026-03-28 21:05:18 [auto1.it] INFO: Found listing with ID: PY58212
2026-03-28 21:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY58212%27 HTTP/1.1" 200 None
2026-03-28 21:05:19 [auto1.it] INFO: Scrape type for PY58212: 0
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: NX47141
2026-03-28 21:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX47141%27 HTTP/1.1" 200 None
2026-03-28 21:05:19 [auto1.it] INFO: Scrape type for NX47141: 0
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: SC24235
2026-03-28 21:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC24235%27 HTTP/1.1" 200 None
2026-03-28 21:05:19 [auto1.it] INFO: Scrape type for SC24235: 0
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: WL97433
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: NL26741
2026-03-28 21:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL26741%27 HTTP/1.1" 200 None
2026-03-28 21:05:19 [auto1.it] INFO: Scrape type for NL26741: 0
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: CR51689
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: PE19282
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: LP93747
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: RA56260
2026-03-28 21:05:19 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/RA56260/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: EK01014
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: ZH89782
2026-03-28 21:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH89782%27 HTTP/1.1" 200 None
2026-03-28 21:05:19 [auto1.it] INFO: Scrape type for ZH89782: 0
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: YS46644
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: RC57618
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: RZ13611
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: TD94995
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: EW86248
2026-03-28 21:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW86248%27 HTTP/1.1" 200 None
2026-03-28 21:05:19 [auto1.it] INFO: Scrape type for EW86248: 0
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: WB67715
2026-03-28 21:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB67715%27 HTTP/1.1" 200 None
2026-03-28 21:05:19 [auto1.it] INFO: Scrape type for WB67715: 0
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: ZK23412
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: KT97112
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: VX54409
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: XH11814
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: KN64287
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: JM92552
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: HP20595
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: RF53509
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: VY56093
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: XS81991
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: KL09391
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: DH11119
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: VL58331
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: MW24611
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: WJ42513
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: RX80413
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: JK04484
2026-03-28 21:05:19 [auto1.it] INFO: Found listing with ID: ZE02722
2026-03-28 21:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZE02722/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RF53509/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WJ42513/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YS46644> (referer: https://www.auto1.com/v1/car-details-view/YS46644/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b256846-5bdd-5aa4-b558-c772b6f3335b with identifier: YS46644
2026-03-28 21:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b256846-5bdd-5aa4-b558-c772b6f3335b with scrape type 1
2026-03-28 21:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5b256846-5bdd-5aa4-b558-c772b6f3335b
2026-03-28 21:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Faf%252Fe2af27db62d703ea4c6eb9a9460485d7%252Fpa%252FYS46644_ed6584a271e0b0564bde42ee76afad43.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_ed6584a271e0b0564bde42ee76afad43.jpg already downloaded
2026-03-28 21:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Faf%252Fe2af27db62d703ea4c6eb9a9460485d7%252Fpa%252FYS46644_be1ff663b2de5d80d86ac82f3bec2764.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_be1ff663b2de5d80d86ac82f3bec2764.jpg already downloaded
2026-03-28 21:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Faf%252Fe2af27db62d703ea4c6eb9a9460485d7%252Fpa%252FYS46644_7eed7b66da07870fa1a4b806e6feede2.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_7eed7b66da07870fa1a4b806e6feede2.jpg already downloaded
2026-03-28 21:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Faf%252Fe2af27db62d703ea4c6eb9a9460485d7%252Fpa%252FYS46644_cf762331daf3b726acb77dd6b775bf62.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_cf762331daf3b726acb77dd6b775bf62.jpg already downloaded
2026-03-28 21:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Faf%252Fe2af27db62d703ea4c6eb9a9460485d7%252Fpa%252FYS46644_9a5fa6839c66246f106971dae170f3c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_9a5fa6839c66246f106971dae170f3c2.jpg already downloaded
2026-03-28 21:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Faf%252Fe2af27db62d703ea4c6eb9a9460485d7%252Fpa%252FYS46644_6fb80af350165b7530129b93d649e0df.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_6fb80af350165b7530129b93d649e0df.jpg already downloaded
2026-03-28 21:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Faf%252Fe2af27db62d703ea4c6eb9a9460485d7%252Fpa%252FYS46644_7b8634477fa95467db7ba69a62a12ebc.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_7b8634477fa95467db7ba69a62a12ebc.jpg already downloaded
2026-03-28 21:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Faf%252Fe2af27db62d703ea4c6eb9a9460485d7%252Fpa%252FYS46644_b4cddd1d279c439cb5449462040a9435.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_b4cddd1d279c439cb5449462040a9435.jpg already downloaded
2026-03-28 21:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Faf%252Fe2af27db62d703ea4c6eb9a9460485d7%252Fpa%252FYS46644_079fec43158d9f90f5825bd72d4b6d1d.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_079fec43158d9f90f5825bd72d4b6d1d.jpg already downloaded
2026-03-28 21:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Faf%252Fe2af27db62d703ea4c6eb9a9460485d7%252Fpa%252FYS46644_59c4699edf5c776b3e78ea3ab8eaf2a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_59c4699edf5c776b3e78ea3ab8eaf2a9.jpg already downloaded
2026-03-28 21:05:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5b256846-5bdd-5aa4-b558-c772b6f3335b, identifier: YS46644
2026-03-28 21:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5b256846-5bdd-5aa4-b558-c772b6f3335b with identifier: YS46644
2026-03-28 21:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5b256846-5bdd-5aa4-b558-c772b6f3335b with identifier: YS46644
2026-03-28 21:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5b256846-5bdd-5aa4-b558-c772b6f3335b with identifier: YS46644 to the API
2026-03-28 21:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YS46644>
{'auction_title': '',
'c_o_2_emission_value': 106,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:50:14Z',
'fuel_type': 'diesel',
'id': '5b256846-5bdd-5aa4-b558-c772b6f3335b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS46644',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'make': 'Audi',
'model': 'A3',
'odometer': 331272,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_ed6584a271e0b0564bde42ee76afad43.jpg',
'https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_be1ff663b2de5d80d86ac82f3bec2764.jpg',
'https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_7eed7b66da07870fa1a4b806e6feede2.jpg',
'https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_cf762331daf3b726acb77dd6b775bf62.jpg',
'https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_9a5fa6839c66246f106971dae170f3c2.jpg',
'https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_6fb80af350165b7530129b93d649e0df.jpg',
'https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_7b8634477fa95467db7ba69a62a12ebc.jpg',
'https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_b4cddd1d279c439cb5449462040a9435.jpg',
'https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_079fec43158d9f90f5825bd72d4b6d1d.jpg',
'https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_59c4699edf5c776b3e78ea3ab8eaf2a9.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b256846-5bdd-5aa4-b558-c772b6f3335b/5b256846-5bdd-5aa4-b558-c772b6f3335b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87633,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_ed6584a271e0b0564bde42ee76afad43.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b256846-5bdd-5aa4-b558-c772b6f3335b/5b256846-5bdd-5aa4-b558-c772b6f3335b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77266,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_be1ff663b2de5d80d86ac82f3bec2764.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b256846-5bdd-5aa4-b558-c772b6f3335b/5b256846-5bdd-5aa4-b558-c772b6f3335b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84764,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_7eed7b66da07870fa1a4b806e6feede2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b256846-5bdd-5aa4-b558-c772b6f3335b/5b256846-5bdd-5aa4-b558-c772b6f3335b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63649,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_cf762331daf3b726acb77dd6b775bf62.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b256846-5bdd-5aa4-b558-c772b6f3335b/5b256846-5bdd-5aa4-b558-c772b6f3335b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69128,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_9a5fa6839c66246f106971dae170f3c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b256846-5bdd-5aa4-b558-c772b6f3335b/5b256846-5bdd-5aa4-b558-c772b6f3335b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2647557,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_6fb80af350165b7530129b93d649e0df.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b256846-5bdd-5aa4-b558-c772b6f3335b/5b256846-5bdd-5aa4-b558-c772b6f3335b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63177,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_7b8634477fa95467db7ba69a62a12ebc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b256846-5bdd-5aa4-b558-c772b6f3335b/5b256846-5bdd-5aa4-b558-c772b6f3335b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79996,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_b4cddd1d279c439cb5449462040a9435.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b256846-5bdd-5aa4-b558-c772b6f3335b/5b256846-5bdd-5aa4-b558-c772b6f3335b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75327,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_079fec43158d9f90f5825bd72d4b6d1d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b256846-5bdd-5aa4-b558-c772b6f3335b/5b256846-5bdd-5aa4-b558-c772b6f3335b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82810,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/af/e2af27db62d703ea4c6eb9a9460485d7/pa/YS46644_59c4699edf5c776b3e78ea3ab8eaf2a9.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 2.0 TDI S line Sportpaket',
'transmission': 'manual',
'trim': 'S line Sportpaket',
'year': 2014}
2026-03-28 21:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS46644%27 HTTP/1.1" 200 None
2026-03-28 21:05:20 [auto1.it] INFO: Saving data for YS46644: {'created_time': 1774731920.867053, 'last_price_update_time': 1774731920.86707, 'auction_closing_time': 1774885814.0}
2026-03-28 21:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YS46644') HTTP/1.1" 204 0
2026-03-28 21:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RX80413/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RC57618> (referer: https://www.auto1.com/v1/car-details-view/RC57618/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XH11814> (referer: https://www.auto1.com/v1/car-details-view/XH11814/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59ac5c36-0ad7-5ee1-938c-9b7f4978546c with identifier: RC57618
2026-03-28 21:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59ac5c36-0ad7-5ee1-938c-9b7f4978546c with scrape type 1
2026-03-28 21:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 59ac5c36-0ad7-5ee1-938c-9b7f4978546c
2026-03-28 21:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F21%252Ff0211f42cfda52a50928d0119fff9595%252Fpa%252FRC57618_d0edb3340b191986dafede1830f06a07.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/21/f0211f42cfda52a50928d0119fff9595/pa/RC57618_d0edb3340b191986dafede1830f06a07.jpg already downloaded
2026-03-28 21:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F21%252Ff0211f42cfda52a50928d0119fff9595%252Fpa%252FRC57618_67f45ed3e40aa19b4aa87a178abb6cb8.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/21/f0211f42cfda52a50928d0119fff9595/pa/RC57618_67f45ed3e40aa19b4aa87a178abb6cb8.jpg already downloaded
2026-03-28 21:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F21%252Ff0211f42cfda52a50928d0119fff9595%252Fpa%252FRC57618_c3297741bc82c677dbaf10f35b5d13c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/21/f0211f42cfda52a50928d0119fff9595/pa/RC57618_c3297741bc82c677dbaf10f35b5d13c3.jpg already downloaded
2026-03-28 21:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F21%252Ff0211f42cfda52a50928d0119fff9595%252Fpa%252FRC57618_5201d34f40260d63392ba26e4b21eff2.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/21/f0211f42cfda52a50928d0119fff9595/pa/RC57618_5201d34f40260d63392ba26e4b21eff2.jpg already downloaded
2026-03-28 21:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F21%252Ff0211f42cfda52a50928d0119fff9595%252Fpa%252FRC57618_fd4e4a82cc940d048285059fab8c778c.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/21/f0211f42cfda52a50928d0119fff9595/pa/RC57618_fd4e4a82cc940d048285059fab8c778c.jpg already downloaded
2026-03-28 21:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 59ac5c36-0ad7-5ee1-938c-9b7f4978546c, identifier: RC57618
2026-03-28 21:05:21 [auto1.it] INFO: Channel: 24h | Page: 2 | totalHits: 2224 | hits on page: 40
2026-03-28 21:05:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 59ac5c36-0ad7-5ee1-938c-9b7f4978546c with identifier: RC57618
2026-03-28 21:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 21:05:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 21:05:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 21:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 21:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 59ac5c36-0ad7-5ee1-938c-9b7f4978546c with identifier: RC57618
2026-03-28 21:05:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 59ac5c36-0ad7-5ee1-938c-9b7f4978546c with identifier: RC57618 to the API
2026-03-28 21:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RC57618>
{'auction_title': '',
'c_o_2_emission_value': 159,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:25:27Z',
'fuel_type': 'diesel',
'id': '59ac5c36-0ad7-5ee1-938c-9b7f4978546c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC57618',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'make': 'Chevrolet',
'model': 'Orlando',
'odometer': 276413,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/imgf0/21/f0211f42cfda52a50928d0119fff9595/pa/RC57618_d0edb3340b191986dafede1830f06a07.jpg',
'https://img-pa.auto1.com/imgf0/21/f0211f42cfda52a50928d0119fff9595/pa/RC57618_67f45ed3e40aa19b4aa87a178abb6cb8.jpg',
'https://img-pa.auto1.com/imgf0/21/f0211f42cfda52a50928d0119fff9595/pa/RC57618_c3297741bc82c677dbaf10f35b5d13c3.jpg',
'https://img-pa.auto1.com/imgf0/21/f0211f42cfda52a50928d0119fff9595/pa/RC57618_5201d34f40260d63392ba26e4b21eff2.jpg',
'https://img-pa.auto1.com/imgf0/21/f0211f42cfda52a50928d0119fff9595/pa/RC57618_fd4e4a82cc940d048285059fab8c778c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59ac5c36-0ad7-5ee1-938c-9b7f4978546c/59ac5c36-0ad7-5ee1-938c-9b7f4978546c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71088,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/21/f0211f42cfda52a50928d0119fff9595/pa/RC57618_d0edb3340b191986dafede1830f06a07.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59ac5c36-0ad7-5ee1-938c-9b7f4978546c/59ac5c36-0ad7-5ee1-938c-9b7f4978546c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69877,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/21/f0211f42cfda52a50928d0119fff9595/pa/RC57618_67f45ed3e40aa19b4aa87a178abb6cb8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59ac5c36-0ad7-5ee1-938c-9b7f4978546c/59ac5c36-0ad7-5ee1-938c-9b7f4978546c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66394,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/21/f0211f42cfda52a50928d0119fff9595/pa/RC57618_c3297741bc82c677dbaf10f35b5d13c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59ac5c36-0ad7-5ee1-938c-9b7f4978546c/59ac5c36-0ad7-5ee1-938c-9b7f4978546c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58135,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/21/f0211f42cfda52a50928d0119fff9595/pa/RC57618_5201d34f40260d63392ba26e4b21eff2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59ac5c36-0ad7-5ee1-938c-9b7f4978546c/59ac5c36-0ad7-5ee1-938c-9b7f4978546c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69118,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/21/f0211f42cfda52a50928d0119fff9595/pa/RC57618_fd4e4a82cc940d048285059fab8c778c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-03-30',
'seats_number': 7,
'seller_name': None,
'title': 'Chevrolet Orlando 2.0 Diesel LT',
'transmission': 'manual',
'trim': 'LT',
'year': 2011}
2026-03-28 21:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC57618%27 HTTP/1.1" 200 None
2026-03-28 21:05:21 [auto1.it] INFO: Saving data for RC57618: {'created_time': 1774731921.768663, 'last_price_update_time': 1774731921.768674, 'auction_closing_time': 1774884327.0}
2026-03-28 21:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RC57618') HTTP/1.1" 204 0
2026-03-28 21:05:21 [auto1.it] INFO: Found listing with ID: PA82276
2026-03-28 21:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA82276%27 HTTP/1.1" 200 None
2026-03-28 21:05:21 [auto1.it] INFO: Scrape type for PA82276: 2
2026-03-28 21:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5074521-41b1-59fc-9517-2d58c6fe5909 with identifier: PA82276
2026-03-28 21:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5074521-41b1-59fc-9517-2d58c6fe5909 with scrape type 2
2026-03-28 21:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5074521-41b1-59fc-9517-2d58c6fe5909 with scrape type 2
2026-03-28 21:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e5074521-41b1-59fc-9517-2d58c6fe5909, identifier: PA82276
2026-03-28 21:05:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e5074521-41b1-59fc-9517-2d58c6fe5909 with identifier: PA82276
2026-03-28 21:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 21:05:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 21:05:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 21:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e5074521-41b1-59fc-9517-2d58c6fe5909 with identifier: PA82276
2026-03-28 21:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e5074521-41b1-59fc-9517-2d58c6fe5909 with identifier: PA82276 to the API
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 280,
'expiration_date': '2026-03-30T15:48:46Z',
'fuel_type': 'hybrid',
'id': 'e5074521-41b1-59fc-9517-2d58c6fe5909',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA82276',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'Tonale',
'odometer': 22789,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-26',
'seller_name': None,
'title': 'Alfa Romeo Tonale 1.3 Plug-in Hybrid Veloce AWD',
'transmission': 'automatic',
'trim': 'Veloce AWD',
'year': 2023}
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA82276%27 HTTP/1.1" 200 None
2026-03-28 21:05:22 [auto1.it] INFO: Saving data for PA82276: {'auction_closing_time': 1774885726.0, 'created_time': 1774300195.764794, 'last_price_update_time': 1774731922.405952}
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PA82276') HTTP/1.1" 204 0
2026-03-28 21:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e77a728-1224-5203-9802-84ea63be5a14 with identifier: XH11814
2026-03-28 21:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e77a728-1224-5203-9802-84ea63be5a14 with scrape type 1
2026-03-28 21:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e77a728-1224-5203-9802-84ea63be5a14
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F6e%252F306e7f8092cccf732da3aa33249c36f3%252Fpa%252FXH11814_d537992198c9edfd86df967c9f90f7c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_d537992198c9edfd86df967c9f90f7c6.jpg already downloaded
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F6e%252F306e7f8092cccf732da3aa33249c36f3%252Fpa%252FXH11814_6874ad418f27b123034556239ffd04dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_6874ad418f27b123034556239ffd04dc.jpg already downloaded
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F6e%252F306e7f8092cccf732da3aa33249c36f3%252Fpa%252FXH11814_65fe08b30fd1fb9aaa8425bdb0741108.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_65fe08b30fd1fb9aaa8425bdb0741108.jpg already downloaded
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F6e%252F306e7f8092cccf732da3aa33249c36f3%252Fpa%252FXH11814_22198b36434bf978ae627d6ccedf3a06.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_22198b36434bf978ae627d6ccedf3a06.jpg already downloaded
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F6e%252F306e7f8092cccf732da3aa33249c36f3%252Fpa%252FXH11814_6b80cad65daaea25e253d25817228c4f.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_6b80cad65daaea25e253d25817228c4f.jpg already downloaded
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F6e%252F306e7f8092cccf732da3aa33249c36f3%252Fpa%252FXH11814_5186a799b794f7ad81568ec95fce29e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_5186a799b794f7ad81568ec95fce29e9.jpg already downloaded
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F6e%252F306e7f8092cccf732da3aa33249c36f3%252Fpa%252FXH11814_7a1276b7b9a05f3d5369481ca1334dbc.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_7a1276b7b9a05f3d5369481ca1334dbc.jpg already downloaded
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F6e%252F306e7f8092cccf732da3aa33249c36f3%252Fpa%252FXH11814_a6c77f924686ce265a6ec50c9d8d3bfa.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_a6c77f924686ce265a6ec50c9d8d3bfa.jpg already downloaded
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F6e%252F306e7f8092cccf732da3aa33249c36f3%252Fpa%252FXH11814_13492d000f49574d876e9cded79f6142.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_13492d000f49574d876e9cded79f6142.jpg already downloaded
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F6e%252F306e7f8092cccf732da3aa33249c36f3%252Fpa%252FXH11814_17e05e41864c12e62c8e62c047a392a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_17e05e41864c12e62c8e62c047a392a5.jpg already downloaded
2026-03-28 21:05:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8e77a728-1224-5203-9802-84ea63be5a14, identifier: XH11814
2026-03-28 21:05:22 [auto1.it] INFO: Found listing with ID: XE77432
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE77432%27 HTTP/1.1" 200 None
2026-03-28 21:05:22 [auto1.it] INFO: Scrape type for XE77432: 1
2026-03-28 21:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VX54409> (referer: https://www.auto1.com/v1/car-details-view/VX54409/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8e77a728-1224-5203-9802-84ea63be5a14 with identifier: XH11814
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 21:05:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 21:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8e77a728-1224-5203-9802-84ea63be5a14 with identifier: XH11814
2026-03-28 21:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8e77a728-1224-5203-9802-84ea63be5a14 with identifier: XH11814 to the API
2026-03-28 21:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XH11814>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:12:52Z',
'fuel_type': 'petrol',
'id': '8e77a728-1224-5203-9802-84ea63be5a14',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH11814',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Fiat',
'model': '500',
'odometer': 106300,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_d537992198c9edfd86df967c9f90f7c6.jpg',
'https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_6874ad418f27b123034556239ffd04dc.jpg',
'https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_65fe08b30fd1fb9aaa8425bdb0741108.jpg',
'https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_22198b36434bf978ae627d6ccedf3a06.jpg',
'https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_6b80cad65daaea25e253d25817228c4f.jpg',
'https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_5186a799b794f7ad81568ec95fce29e9.jpg',
'https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_7a1276b7b9a05f3d5369481ca1334dbc.jpg',
'https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_a6c77f924686ce265a6ec50c9d8d3bfa.jpg',
'https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_13492d000f49574d876e9cded79f6142.jpg',
'https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_17e05e41864c12e62c8e62c047a392a5.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e77a728-1224-5203-9802-84ea63be5a14/8e77a728-1224-5203-9802-84ea63be5a14_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2619577,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_d537992198c9edfd86df967c9f90f7c6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e77a728-1224-5203-9802-84ea63be5a14/8e77a728-1224-5203-9802-84ea63be5a14_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2567894,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_6874ad418f27b123034556239ffd04dc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e77a728-1224-5203-9802-84ea63be5a14/8e77a728-1224-5203-9802-84ea63be5a14_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68931,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_65fe08b30fd1fb9aaa8425bdb0741108.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e77a728-1224-5203-9802-84ea63be5a14/8e77a728-1224-5203-9802-84ea63be5a14_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63037,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_22198b36434bf978ae627d6ccedf3a06.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e77a728-1224-5203-9802-84ea63be5a14/8e77a728-1224-5203-9802-84ea63be5a14_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2362348,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_6b80cad65daaea25e253d25817228c4f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e77a728-1224-5203-9802-84ea63be5a14/8e77a728-1224-5203-9802-84ea63be5a14_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2547133,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_5186a799b794f7ad81568ec95fce29e9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e77a728-1224-5203-9802-84ea63be5a14/8e77a728-1224-5203-9802-84ea63be5a14_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46734,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_7a1276b7b9a05f3d5369481ca1334dbc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e77a728-1224-5203-9802-84ea63be5a14/8e77a728-1224-5203-9802-84ea63be5a14_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75029,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_a6c77f924686ce265a6ec50c9d8d3bfa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e77a728-1224-5203-9802-84ea63be5a14/8e77a728-1224-5203-9802-84ea63be5a14_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2574108,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_13492d000f49574d876e9cded79f6142.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e77a728-1224-5203-9802-84ea63be5a14/8e77a728-1224-5203-9802-84ea63be5a14_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2443994,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img30/6e/306e7f8092cccf732da3aa33249c36f3/pa/XH11814_17e05e41864c12e62c8e62c047a392a5.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-05-27',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 1.0 Mild-Hybrid Dolcevita',
'transmission': 'manual',
'trim': 'Dolcevita',
'year': 2021}
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH11814%27 HTTP/1.1" 200 None
2026-03-28 21:05:23 [auto1.it] INFO: Saving data for XH11814: {'created_time': 1774731923.197983, 'last_price_update_time': 1774731923.197995, 'auction_closing_time': 1774883572.0}
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XH11814') HTTP/1.1" 204 0
2026-03-28 21:05:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:23 [auto1.it] INFO: Found listing with ID: BG27865
2026-03-28 21:05:23 [auto1.it] INFO: Found listing with ID: EK32086
2026-03-28 21:05:23 [auto1.it] INFO: Found listing with ID: VN61969
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VN61969%27 HTTP/1.1" 200 None
2026-03-28 21:05:23 [auto1.it] INFO: Scrape type for VN61969: 2
2026-03-28 21:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6d61ec0-75bd-566c-be8b-39479db35190 with identifier: VN61969
2026-03-28 21:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6d61ec0-75bd-566c-be8b-39479db35190 with scrape type 2
2026-03-28 21:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6d61ec0-75bd-566c-be8b-39479db35190 with scrape type 2
2026-03-28 21:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a6d61ec0-75bd-566c-be8b-39479db35190, identifier: VN61969
2026-03-28 21:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a6d61ec0-75bd-566c-be8b-39479db35190 with identifier: VN61969
2026-03-28 21:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a6d61ec0-75bd-566c-be8b-39479db35190 with identifier: VN61969
2026-03-28 21:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a6d61ec0-75bd-566c-be8b-39479db35190 with identifier: VN61969 to the API
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 211,
'expiration_date': '2026-03-30T15:00:32Z',
'fuel_type': 'diesel',
'id': 'a6d61ec0-75bd-566c-be8b-39479db35190',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN61969',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 173089,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-23',
'seller_name': None,
'title': 'Volvo XC60 2.0 B4 Diesel Mild-Hybrid Inscription AWD',
'transmission': 'automatic',
'trim': 'Inscription AWD',
'year': 2020}
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VN61969%27 HTTP/1.1" 200 None
2026-03-28 21:05:23 [auto1.it] INFO: Saving data for VN61969: {'auction_closing_time': 1774882832.0, 'created_time': 1773136159.559152, 'last_price_update_time': 1774731923.688128}
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VN61969') HTTP/1.1" 204 0
2026-03-28 21:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90b73320-69cc-543a-8db6-2bf838e9e84a with identifier: VX54409
2026-03-28 21:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90b73320-69cc-543a-8db6-2bf838e9e84a with scrape type 1
2026-03-28 21:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 90b73320-69cc-543a-8db6-2bf838e9e84a
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe9%252F87e988babc832d3062cd5fdbcb10b6ad%252Fpa%252FVX54409_8a90de52175b651f6df638fb46c6c7a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_8a90de52175b651f6df638fb46c6c7a3.jpg already downloaded
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe9%252F87e988babc832d3062cd5fdbcb10b6ad%252Fpa%252FVX54409_34bdbea72ade8f5fd6ff50654c5e58ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_34bdbea72ade8f5fd6ff50654c5e58ac.jpg already downloaded
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe9%252F87e988babc832d3062cd5fdbcb10b6ad%252Fpa%252FVX54409_b2fdefd3bea7ef8118dd656515f82575.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_b2fdefd3bea7ef8118dd656515f82575.jpg already downloaded
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe9%252F87e988babc832d3062cd5fdbcb10b6ad%252Fpa%252FVX54409_e29659c1175ed0a09c15fa0d51fe2a2e.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_e29659c1175ed0a09c15fa0d51fe2a2e.jpg already downloaded
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe9%252F87e988babc832d3062cd5fdbcb10b6ad%252Fpa%252FVX54409_c97b244a7b8aa6510e293c1cd0d0e80a.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_c97b244a7b8aa6510e293c1cd0d0e80a.jpg already downloaded
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe9%252F87e988babc832d3062cd5fdbcb10b6ad%252Fpa%252FVX54409_9fac0ca4fef31baf70f44e3399593552.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_9fac0ca4fef31baf70f44e3399593552.jpg already downloaded
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe9%252F87e988babc832d3062cd5fdbcb10b6ad%252Fpa%252FVX54409_2a2bd695d2d6e5211e061431de870af3.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_2a2bd695d2d6e5211e061431de870af3.jpg already downloaded
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe9%252F87e988babc832d3062cd5fdbcb10b6ad%252Fpa%252FVX54409_15da5fa82121fd99a707cb63ce83f413.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_15da5fa82121fd99a707cb63ce83f413.jpg already downloaded
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe9%252F87e988babc832d3062cd5fdbcb10b6ad%252Fpa%252FVX54409_55a0cae30f29e16aa5b2123fd7815a03.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_55a0cae30f29e16aa5b2123fd7815a03.jpg already downloaded
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe9%252F87e988babc832d3062cd5fdbcb10b6ad%252Fpa%252FVX54409_d21bc790a7078f1924635b8943b9bae3.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_d21bc790a7078f1924635b8943b9bae3.jpg already downloaded
2026-03-28 21:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 90b73320-69cc-543a-8db6-2bf838e9e84a, identifier: VX54409
2026-03-28 21:05:24 [auto1.it] INFO: Found listing with ID: RH32617
2026-03-28 21:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RH32617%27 HTTP/1.1" 200 None
2026-03-28 21:05:24 [auto1.it] INFO: Scrape type for RH32617: 2
2026-03-28 21:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80d5d8e7-d32b-5e95-8bc9-9fb9ac558b5e with identifier: RH32617
2026-03-28 21:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80d5d8e7-d32b-5e95-8bc9-9fb9ac558b5e with scrape type 2
2026-03-28 21:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80d5d8e7-d32b-5e95-8bc9-9fb9ac558b5e with scrape type 2
2026-03-28 21:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 80d5d8e7-d32b-5e95-8bc9-9fb9ac558b5e, identifier: RH32617
2026-03-28 21:05:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 90b73320-69cc-543a-8db6-2bf838e9e84a with identifier: VX54409
2026-03-28 21:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 21:05:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 21:05:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 21:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 21:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 90b73320-69cc-543a-8db6-2bf838e9e84a with identifier: VX54409
2026-03-28 21:05:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 90b73320-69cc-543a-8db6-2bf838e9e84a with identifier: VX54409 to the API
2026-03-28 21:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VX54409>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.6L',
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:34:03Z',
'fuel_type': 'diesel',
'id': '90b73320-69cc-543a-8db6-2bf838e9e84a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX54409',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 129452,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_8a90de52175b651f6df638fb46c6c7a3.jpg',
'https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_34bdbea72ade8f5fd6ff50654c5e58ac.jpg',
'https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_b2fdefd3bea7ef8118dd656515f82575.jpg',
'https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_e29659c1175ed0a09c15fa0d51fe2a2e.jpg',
'https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_c97b244a7b8aa6510e293c1cd0d0e80a.jpg',
'https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_9fac0ca4fef31baf70f44e3399593552.jpg',
'https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_2a2bd695d2d6e5211e061431de870af3.jpg',
'https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_15da5fa82121fd99a707cb63ce83f413.jpg',
'https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_55a0cae30f29e16aa5b2123fd7815a03.jpg',
'https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_d21bc790a7078f1924635b8943b9bae3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b73320-69cc-543a-8db6-2bf838e9e84a/90b73320-69cc-543a-8db6-2bf838e9e84a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123147,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_8a90de52175b651f6df638fb46c6c7a3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b73320-69cc-543a-8db6-2bf838e9e84a/90b73320-69cc-543a-8db6-2bf838e9e84a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3432249,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_34bdbea72ade8f5fd6ff50654c5e58ac.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b73320-69cc-543a-8db6-2bf838e9e84a/90b73320-69cc-543a-8db6-2bf838e9e84a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113291,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_b2fdefd3bea7ef8118dd656515f82575.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b73320-69cc-543a-8db6-2bf838e9e84a/90b73320-69cc-543a-8db6-2bf838e9e84a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3260160,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_e29659c1175ed0a09c15fa0d51fe2a2e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b73320-69cc-543a-8db6-2bf838e9e84a/90b73320-69cc-543a-8db6-2bf838e9e84a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3508446,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_c97b244a7b8aa6510e293c1cd0d0e80a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b73320-69cc-543a-8db6-2bf838e9e84a/90b73320-69cc-543a-8db6-2bf838e9e84a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3350749,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_9fac0ca4fef31baf70f44e3399593552.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b73320-69cc-543a-8db6-2bf838e9e84a/90b73320-69cc-543a-8db6-2bf838e9e84a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103412,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_2a2bd695d2d6e5211e061431de870af3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b73320-69cc-543a-8db6-2bf838e9e84a/90b73320-69cc-543a-8db6-2bf838e9e84a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104756,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_15da5fa82121fd99a707cb63ce83f413.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b73320-69cc-543a-8db6-2bf838e9e84a/90b73320-69cc-543a-8db6-2bf838e9e84a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3394135,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_55a0cae30f29e16aa5b2123fd7815a03.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90b73320-69cc-543a-8db6-2bf838e9e84a/90b73320-69cc-543a-8db6-2bf838e9e84a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2950457,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img87/e9/87e988babc832d3062cd5fdbcb10b6ad/pa/VX54409_d21bc790a7078f1924635b8943b9bae3.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-12-31',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.6 dCi Acenta',
'transmission': 'automatic',
'trim': 'Acenta',
'year': 2013}
2026-03-28 21:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VX54409%27 HTTP/1.1" 200 None
2026-03-28 21:05:24 [auto1.it] INFO: Saving data for VX54409: {'created_time': 1774731924.630081, 'last_price_update_time': 1774731924.630099, 'auction_closing_time': 1774884843.0}
2026-03-28 21:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VX54409') HTTP/1.1" 204 0
2026-03-28 21:05:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 80d5d8e7-d32b-5e95-8bc9-9fb9ac558b5e with identifier: RH32617
2026-03-28 21:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 80d5d8e7-d32b-5e95-8bc9-9fb9ac558b5e with identifier: RH32617
2026-03-28 21:05:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 80d5d8e7-d32b-5e95-8bc9-9fb9ac558b5e with identifier: RH32617 to the API
2026-03-28 21:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:31:53Z',
'fuel_type': 'petrol',
'id': '80d5d8e7-d32b-5e95-8bc9-9fb9ac558b5e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH32617',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC40',
'odometer': 167607,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-20',
'seller_name': None,
'title': 'Volvo XC40 1.5 Momentum 2WD',
'transmission': 'manual',
'trim': 'Momentum 2WD',
'year': 2018}
2026-03-28 21:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RH32617%27 HTTP/1.1" 200 None
2026-03-28 21:05:24 [auto1.it] INFO: Saving data for RH32617: {'auction_closing_time': 1774884713.0, 'created_time': 1773134566.021168, 'last_price_update_time': 1774731924.965851}
2026-03-28 21:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RH32617') HTTP/1.1" 204 0
2026-03-28 21:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RA56260> (referer: https://www.auto1.com/v1/car-details-view/RA56260/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RZ13611> (referer: https://www.auto1.com/v1/car-details-view/RZ13611/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:24 [auto1.it] INFO: Found listing with ID: TJ05076
2026-03-28 21:05:24 [auto1.it] INFO: Found listing with ID: PZ73460
2026-03-28 21:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ73460%27 HTTP/1.1" 200 None
2026-03-28 21:05:25 [auto1.it] INFO: Scrape type for PZ73460: 1
2026-03-28 21:05:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WJ42513> (referer: https://www.auto1.com/v1/car-details-view/WJ42513/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZE02722> (referer: https://www.auto1.com/v1/car-details-view/ZE02722/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RF53509> (referer: https://www.auto1.com/v1/car-details-view/RF53509/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:25 [auto1.it] INFO: Found listing with ID: TY12720
2026-03-28 21:05:25 [auto1.it] INFO: Found listing with ID: RS94831
2026-03-28 21:05:25 [auto1.it] INFO: Found listing with ID: BZ50824
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ50824%27 HTTP/1.1" 200 None
2026-03-28 21:05:25 [auto1.it] INFO: Scrape type for BZ50824: 1
2026-03-28 21:05:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:25 [auto1.it] INFO: Found listing with ID: TW69168
2026-03-28 21:05:25 [auto1.it] INFO: Found listing with ID: XK06732
2026-03-28 21:05:25 [auto1.it] INFO: Found listing with ID: CE45515
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE45515%27 HTTP/1.1" 200 None
2026-03-28 21:05:25 [auto1.it] INFO: Scrape type for CE45515: 2
2026-03-28 21:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f5600a8-d864-5459-824b-7a3816ea2076 with identifier: CE45515
2026-03-28 21:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f5600a8-d864-5459-824b-7a3816ea2076 with scrape type 2
2026-03-28 21:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f5600a8-d864-5459-824b-7a3816ea2076 with scrape type 2
2026-03-28 21:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0f5600a8-d864-5459-824b-7a3816ea2076, identifier: CE45515
2026-03-28 21:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0f5600a8-d864-5459-824b-7a3816ea2076 with identifier: CE45515
2026-03-28 21:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0f5600a8-d864-5459-824b-7a3816ea2076 with identifier: CE45515
2026-03-28 21:05:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0f5600a8-d864-5459-824b-7a3816ea2076 with identifier: CE45515 to the API
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:51:36Z',
'fuel_type': 'diesel',
'id': '0f5600a8-d864-5459-824b-7a3816ea2076',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE45515',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3 Picasso',
'odometer': 82237,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-28',
'seller_name': None,
'title': 'Citroen C3 Picasso 1.6 Blue-HDi Exclusive',
'transmission': 'manual',
'trim': 'Exclusive',
'year': 2017}
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE45515%27 HTTP/1.1" 200 None
2026-03-28 21:05:25 [auto1.it] INFO: Saving data for CE45515: {'auction_closing_time': 1774885896.0, 'created_time': 1774274834.66357, 'last_price_update_time': 1774731925.476378}
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CE45515') HTTP/1.1" 204 0
2026-03-28 21:05:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:25 [auto1.it] INFO: Found listing with ID: SY67891
2026-03-28 21:05:25 [auto1.it] INFO: Found listing with ID: WE05863
2026-03-28 21:05:25 [auto1.it] INFO: Found listing with ID: KR29976
2026-03-28 21:05:25 [auto1.it] INFO: Found listing with ID: ES96782
2026-03-28 21:05:25 [auto1.it] INFO: Found listing with ID: PU50365
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU50365%27 HTTP/1.1" 200 None
2026-03-28 21:05:25 [auto1.it] INFO: Scrape type for PU50365: 1
2026-03-28 21:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2282b2b7-5f4a-5dec-9f5f-f4d96ffbafd6 with identifier: RA56260
2026-03-28 21:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2282b2b7-5f4a-5dec-9f5f-f4d96ffbafd6 with scrape type 1
2026-03-28 21:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 2282b2b7-5f4a-5dec-9f5f-f4d96ffbafd6
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fa4%252F42a4f698f20d9c4f1d025f0b4689a1ed%252Fpa%252FRA56260_0cbab5ef5837ce92169f1f012c252c75.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/a4/42a4f698f20d9c4f1d025f0b4689a1ed/pa/RA56260_0cbab5ef5837ce92169f1f012c252c75.jpg already downloaded
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fa4%252F42a4f698f20d9c4f1d025f0b4689a1ed%252Fpa%252FRA56260_5aaee2a2a32e1737e55cf770e1784b94.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/a4/42a4f698f20d9c4f1d025f0b4689a1ed/pa/RA56260_5aaee2a2a32e1737e55cf770e1784b94.jpg already downloaded
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fa4%252F42a4f698f20d9c4f1d025f0b4689a1ed%252Fpa%252FRA56260_1051855356487d90fa24fd31373dc73a.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/a4/42a4f698f20d9c4f1d025f0b4689a1ed/pa/RA56260_1051855356487d90fa24fd31373dc73a.jpg already downloaded
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fa4%252F42a4f698f20d9c4f1d025f0b4689a1ed%252Fpa%252FRA56260_cbdd2ececf818dfa2fdadecafff8c3ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/a4/42a4f698f20d9c4f1d025f0b4689a1ed/pa/RA56260_cbdd2ececf818dfa2fdadecafff8c3ad.jpg already downloaded
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fa4%252F42a4f698f20d9c4f1d025f0b4689a1ed%252Fpa%252FRA56260_86cc253df8e5602787ebd8499482a3fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/a4/42a4f698f20d9c4f1d025f0b4689a1ed/pa/RA56260_86cc253df8e5602787ebd8499482a3fa.jpg already downloaded
2026-03-28 21:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2282b2b7-5f4a-5dec-9f5f-f4d96ffbafd6, identifier: RA56260
2026-03-28 21:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8698896e-b7e4-5981-8f45-ae229e660c45 with identifier: RZ13611
2026-03-28 21:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8698896e-b7e4-5981-8f45-ae229e660c45 with scrape type 1
2026-03-28 21:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8698896e-b7e4-5981-8f45-ae229e660c45
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F78%252F73788f2310b0f58ad3af0c5d994f16f9%252Fpa%252FRZ13611_76fe925c524cff0767c0dee3db4accdc.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_76fe925c524cff0767c0dee3db4accdc.jpg already downloaded
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F78%252F73788f2310b0f58ad3af0c5d994f16f9%252Fpa%252FRZ13611_fb413dad134122b57e7f4eb685df6669.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_fb413dad134122b57e7f4eb685df6669.jpg already downloaded
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F78%252F73788f2310b0f58ad3af0c5d994f16f9%252Fpa%252FRZ13611_f5f9898e45520e7354de6dcce03e1391.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_f5f9898e45520e7354de6dcce03e1391.jpg already downloaded
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F78%252F73788f2310b0f58ad3af0c5d994f16f9%252Fpa%252FRZ13611_ec9c6ead006087a90c234721dc6de527.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_ec9c6ead006087a90c234721dc6de527.jpg already downloaded
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F78%252F73788f2310b0f58ad3af0c5d994f16f9%252Fpa%252FRZ13611_cfddc7695b9dad422766223ff2472a32.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_cfddc7695b9dad422766223ff2472a32.jpg already downloaded
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F78%252F73788f2310b0f58ad3af0c5d994f16f9%252Fpa%252FRZ13611_b5134ccc4fbcfb9a85cf7fbc110e8d4a.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_b5134ccc4fbcfb9a85cf7fbc110e8d4a.jpg already downloaded
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F78%252F73788f2310b0f58ad3af0c5d994f16f9%252Fpa%252FRZ13611_eb5736d24253d309ae5a0b0bb535406a.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_eb5736d24253d309ae5a0b0bb535406a.jpg already downloaded
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F78%252F73788f2310b0f58ad3af0c5d994f16f9%252Fpa%252FRZ13611_4cec1548a7fe94876c9c3796996a8d1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_4cec1548a7fe94876c9c3796996a8d1b.jpg already downloaded
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F78%252F73788f2310b0f58ad3af0c5d994f16f9%252Fpa%252FRZ13611_d847b27bf7867670c10c5ecf53cff195.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_d847b27bf7867670c10c5ecf53cff195.jpg already downloaded
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F78%252F73788f2310b0f58ad3af0c5d994f16f9%252Fpa%252FRZ13611_6ecf6ca2cd36121de70c21707e88449f.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_6ecf6ca2cd36121de70c21707e88449f.jpg already downloaded
2026-03-28 21:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8698896e-b7e4-5981-8f45-ae229e660c45, identifier: RZ13611
2026-03-28 21:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53f298c7-a98c-5c80-aad6-9cfd2cf5770a with identifier: WJ42513
2026-03-28 21:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53f298c7-a98c-5c80-aad6-9cfd2cf5770a with scrape type 1
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 53f298c7-a98c-5c80-aad6-9cfd2cf5770a
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F05%252F0e057655205d0d9ec7e9d9096367ab2c%252Fpa%252FWJ42513_7adacecf033f96f10ebf2e6b9e1812b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_7adacecf033f96f10ebf2e6b9e1812b9.jpg already downloaded
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F05%252F0e057655205d0d9ec7e9d9096367ab2c%252Fpa%252FWJ42513_8a0ccceaa2159f5151aa32cd0f72d193.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_8a0ccceaa2159f5151aa32cd0f72d193.jpg already downloaded
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F05%252F0e057655205d0d9ec7e9d9096367ab2c%252Fpa%252FWJ42513_e0e8273db6c2ab8dab7a3f4f118502d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_e0e8273db6c2ab8dab7a3f4f118502d4.jpg already downloaded
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F05%252F0e057655205d0d9ec7e9d9096367ab2c%252Fpa%252FWJ42513_afff0468eb853855df034b0c3018bdcf.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_afff0468eb853855df034b0c3018bdcf.jpg already downloaded
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F05%252F0e057655205d0d9ec7e9d9096367ab2c%252Fpa%252FWJ42513_3ba5e3f0d91a28c5fa0674c43419ecf6.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_3ba5e3f0d91a28c5fa0674c43419ecf6.jpg already downloaded
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F05%252F0e057655205d0d9ec7e9d9096367ab2c%252Fpa%252FWJ42513_0f117ae8134068d2019972a5a46bef06.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_0f117ae8134068d2019972a5a46bef06.jpg already downloaded
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F05%252F0e057655205d0d9ec7e9d9096367ab2c%252Fpa%252FWJ42513_7a6abbee614a0c705c49e394e25aa6a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_7a6abbee614a0c705c49e394e25aa6a9.jpg already downloaded
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F05%252F0e057655205d0d9ec7e9d9096367ab2c%252Fpa%252FWJ42513_7b1e47974cda0278bcc2d83b512197a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_7b1e47974cda0278bcc2d83b512197a4.jpg already downloaded
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F05%252F0e057655205d0d9ec7e9d9096367ab2c%252Fpa%252FWJ42513_cf5d7d4854352ab6d1433209fb55e5da.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_cf5d7d4854352ab6d1433209fb55e5da.jpg already downloaded
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252F05%252F0e057655205d0d9ec7e9d9096367ab2c%252Fpa%252FWJ42513_b28861cc51a191456c802ac8163e9e9b.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_b28861cc51a191456c802ac8163e9e9b.jpg already downloaded
2026-03-28 21:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 53f298c7-a98c-5c80-aad6-9cfd2cf5770a, identifier: WJ42513
2026-03-28 21:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9b3bc18-88f8-58f7-9ba9-b5f6a9323a70 with identifier: ZE02722
2026-03-28 21:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9b3bc18-88f8-58f7-9ba9-b5f6a9323a70 with scrape type 1
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9b3bc18-88f8-58f7-9ba9-b5f6a9323a70
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F86%252F7886187874a91ab96522f7858ae9b393%252Fpa%252FZE02722_b3e2124f4ec3824c75e9c470c925f455.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_b3e2124f4ec3824c75e9c470c925f455.jpg already downloaded
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F86%252F7886187874a91ab96522f7858ae9b393%252Fpa%252FZE02722_c2aae44bc7583cb8e85d4ba68c981852.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_c2aae44bc7583cb8e85d4ba68c981852.jpg already downloaded
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F86%252F7886187874a91ab96522f7858ae9b393%252Fpa%252FZE02722_50273f4176304765e1caad72b2d0cde0.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_50273f4176304765e1caad72b2d0cde0.jpg already downloaded
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F86%252F7886187874a91ab96522f7858ae9b393%252Fpa%252FZE02722_09c3a6cb7530ca73deeec001df5fd6cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_09c3a6cb7530ca73deeec001df5fd6cc.jpg already downloaded
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F86%252F7886187874a91ab96522f7858ae9b393%252Fpa%252FZE02722_bb28df4429377fa75d52b58e8bd1b61b.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_bb28df4429377fa75d52b58e8bd1b61b.jpg already downloaded
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F86%252F7886187874a91ab96522f7858ae9b393%252Fpa%252FZE02722_0bc968796e00d3a167fd52bec4687797.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_0bc968796e00d3a167fd52bec4687797.jpg already downloaded
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F86%252F7886187874a91ab96522f7858ae9b393%252Fpa%252FZE02722_aca9b4ee20e33c09190ae7c4808588cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_aca9b4ee20e33c09190ae7c4808588cc.jpg already downloaded
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F86%252F7886187874a91ab96522f7858ae9b393%252Fpa%252FZE02722_c08decb96cc1d29f5fe0f24eb7c911df.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_c08decb96cc1d29f5fe0f24eb7c911df.jpg already downloaded
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F86%252F7886187874a91ab96522f7858ae9b393%252Fpa%252FZE02722_a83f98d2725490b2d58cac3c5d94d204.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_a83f98d2725490b2d58cac3c5d94d204.jpg already downloaded
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F86%252F7886187874a91ab96522f7858ae9b393%252Fpa%252FZE02722_9d59cf2ffa93835dbf689cbc741764c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_9d59cf2ffa93835dbf689cbc741764c0.jpg already downloaded
2026-03-28 21:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a9b3bc18-88f8-58f7-9ba9-b5f6a9323a70, identifier: ZE02722
2026-03-28 21:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52cdef6d-01a3-5d4f-a27d-287e39353651 with identifier: RF53509
2026-03-28 21:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52cdef6d-01a3-5d4f-a27d-287e39353651 with scrape type 1
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 52cdef6d-01a3-5d4f-a27d-287e39353651
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fc8%252Ff8c8649f4f88f08f1b866ac29486640b%252Fpa%252FRF53509_35fa754f6f03301c12f839da5112d8ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_35fa754f6f03301c12f839da5112d8ea.jpg already downloaded
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fc8%252Ff8c8649f4f88f08f1b866ac29486640b%252Fpa%252FRF53509_4b00a0293dd81b1da99eae3f0c2f3de4.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_4b00a0293dd81b1da99eae3f0c2f3de4.jpg already downloaded
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fc8%252Ff8c8649f4f88f08f1b866ac29486640b%252Fpa%252FRF53509_49fcb7e3684109fe5dde894f7786bb77.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_49fcb7e3684109fe5dde894f7786bb77.jpg already downloaded
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fc8%252Ff8c8649f4f88f08f1b866ac29486640b%252Fpa%252FRF53509_c67910be4d313a5ce7cc790793defd27.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_c67910be4d313a5ce7cc790793defd27.jpg already downloaded
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fc8%252Ff8c8649f4f88f08f1b866ac29486640b%252Fpa%252FRF53509_764abae7a12f9e68137fffbb2f77835e.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_764abae7a12f9e68137fffbb2f77835e.jpg already downloaded
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fc8%252Ff8c8649f4f88f08f1b866ac29486640b%252Fpa%252FRF53509_a754a060accc1715b0cfa90c29524e6c.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_a754a060accc1715b0cfa90c29524e6c.jpg already downloaded
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fc8%252Ff8c8649f4f88f08f1b866ac29486640b%252Fpa%252FRF53509_71b3f484093325cef80449659a16b107.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_71b3f484093325cef80449659a16b107.jpg already downloaded
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fc8%252Ff8c8649f4f88f08f1b866ac29486640b%252Fpa%252FRF53509_5f3447aaa71a34ea22b8cb55c0aefd86.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_5f3447aaa71a34ea22b8cb55c0aefd86.jpg already downloaded
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fc8%252Ff8c8649f4f88f08f1b866ac29486640b%252Fpa%252FRF53509_857443d324f37baf325cf91f65d0abc0.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_857443d324f37baf325cf91f65d0abc0.jpg already downloaded
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fc8%252Ff8c8649f4f88f08f1b866ac29486640b%252Fpa%252FRF53509_367fae2834b6d493eafe0b415b0ffbba.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_367fae2834b6d493eafe0b415b0ffbba.jpg already downloaded
2026-03-28 21:05:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 52cdef6d-01a3-5d4f-a27d-287e39353651, identifier: RF53509
2026-03-28 21:05:27 [auto1.it] INFO: Found listing with ID: NP45555
2026-03-28 21:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP45555%27 HTTP/1.1" 200 None
2026-03-28 21:05:27 [auto1.it] INFO: Scrape type for NP45555: 2
2026-03-28 21:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88d31c13-ba9d-509e-8305-89eebf81f62a with identifier: NP45555
2026-03-28 21:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88d31c13-ba9d-509e-8305-89eebf81f62a with scrape type 2
2026-03-28 21:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88d31c13-ba9d-509e-8305-89eebf81f62a with scrape type 2
2026-03-28 21:05:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 88d31c13-ba9d-509e-8305-89eebf81f62a, identifier: NP45555
2026-03-28 21:05:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2282b2b7-5f4a-5dec-9f5f-f4d96ffbafd6 with identifier: RA56260
2026-03-28 21:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2282b2b7-5f4a-5dec-9f5f-f4d96ffbafd6 with identifier: RA56260
2026-03-28 21:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2282b2b7-5f4a-5dec-9f5f-f4d96ffbafd6 with identifier: RA56260 to the API
2026-03-28 21:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RA56260>
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:30:31Z',
'fuel_type': 'diesel',
'id': '2282b2b7-5f4a-5dec-9f5f-f4d96ffbafd6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA56260',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'Citroen',
'model': 'C3',
'odometer': 143132,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/img42/a4/42a4f698f20d9c4f1d025f0b4689a1ed/pa/RA56260_0cbab5ef5837ce92169f1f012c252c75.jpg',
'https://img-pa.auto1.com/img42/a4/42a4f698f20d9c4f1d025f0b4689a1ed/pa/RA56260_5aaee2a2a32e1737e55cf770e1784b94.jpg',
'https://img-pa.auto1.com/img42/a4/42a4f698f20d9c4f1d025f0b4689a1ed/pa/RA56260_1051855356487d90fa24fd31373dc73a.jpg',
'https://img-pa.auto1.com/img42/a4/42a4f698f20d9c4f1d025f0b4689a1ed/pa/RA56260_cbdd2ececf818dfa2fdadecafff8c3ad.jpg',
'https://img-pa.auto1.com/img42/a4/42a4f698f20d9c4f1d025f0b4689a1ed/pa/RA56260_86cc253df8e5602787ebd8499482a3fa.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2282b2b7-5f4a-5dec-9f5f-f4d96ffbafd6/2282b2b7-5f4a-5dec-9f5f-f4d96ffbafd6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78133,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/a4/42a4f698f20d9c4f1d025f0b4689a1ed/pa/RA56260_0cbab5ef5837ce92169f1f012c252c75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2282b2b7-5f4a-5dec-9f5f-f4d96ffbafd6/2282b2b7-5f4a-5dec-9f5f-f4d96ffbafd6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84956,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/a4/42a4f698f20d9c4f1d025f0b4689a1ed/pa/RA56260_5aaee2a2a32e1737e55cf770e1784b94.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2282b2b7-5f4a-5dec-9f5f-f4d96ffbafd6/2282b2b7-5f4a-5dec-9f5f-f4d96ffbafd6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68776,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/a4/42a4f698f20d9c4f1d025f0b4689a1ed/pa/RA56260_1051855356487d90fa24fd31373dc73a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2282b2b7-5f4a-5dec-9f5f-f4d96ffbafd6/2282b2b7-5f4a-5dec-9f5f-f4d96ffbafd6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69436,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/a4/42a4f698f20d9c4f1d025f0b4689a1ed/pa/RA56260_cbdd2ececf818dfa2fdadecafff8c3ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2282b2b7-5f4a-5dec-9f5f-f4d96ffbafd6/2282b2b7-5f4a-5dec-9f5f-f4d96ffbafd6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58009,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/a4/42a4f698f20d9c4f1d025f0b4689a1ed/pa/RA56260_86cc253df8e5602787ebd8499482a3fa.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-02-28',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.4 HDi Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2011}
2026-03-28 21:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA56260%27 HTTP/1.1" 200 None
2026-03-28 21:05:27 [auto1.it] INFO: Saving data for RA56260: {'created_time': 1774731927.459549, 'last_price_update_time': 1774731927.45956, 'auction_closing_time': 1774884631.0}
2026-03-28 21:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RA56260') HTTP/1.1" 204 0
2026-03-28 21:05:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8698896e-b7e4-5981-8f45-ae229e660c45 with identifier: RZ13611
2026-03-28 21:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8698896e-b7e4-5981-8f45-ae229e660c45 with identifier: RZ13611
2026-03-28 21:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8698896e-b7e4-5981-8f45-ae229e660c45 with identifier: RZ13611 to the API
2026-03-28 21:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RZ13611>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': 'Rental',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:16:14Z',
'fuel_type': 'petrol',
'id': '8698896e-b7e4-5981-8f45-ae229e660c45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ13611',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'Fiat',
'model': '500',
'odometer': 126465,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_76fe925c524cff0767c0dee3db4accdc.jpg',
'https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_fb413dad134122b57e7f4eb685df6669.jpg',
'https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_f5f9898e45520e7354de6dcce03e1391.jpg',
'https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_ec9c6ead006087a90c234721dc6de527.jpg',
'https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_cfddc7695b9dad422766223ff2472a32.jpg',
'https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_b5134ccc4fbcfb9a85cf7fbc110e8d4a.jpg',
'https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_eb5736d24253d309ae5a0b0bb535406a.jpg',
'https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_4cec1548a7fe94876c9c3796996a8d1b.jpg',
'https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_d847b27bf7867670c10c5ecf53cff195.jpg',
'https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_6ecf6ca2cd36121de70c21707e88449f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8698896e-b7e4-5981-8f45-ae229e660c45/8698896e-b7e4-5981-8f45-ae229e660c45_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2933901,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_76fe925c524cff0767c0dee3db4accdc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8698896e-b7e4-5981-8f45-ae229e660c45/8698896e-b7e4-5981-8f45-ae229e660c45_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62508,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_fb413dad134122b57e7f4eb685df6669.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8698896e-b7e4-5981-8f45-ae229e660c45/8698896e-b7e4-5981-8f45-ae229e660c45_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70997,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_f5f9898e45520e7354de6dcce03e1391.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8698896e-b7e4-5981-8f45-ae229e660c45/8698896e-b7e4-5981-8f45-ae229e660c45_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2788546,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_ec9c6ead006087a90c234721dc6de527.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8698896e-b7e4-5981-8f45-ae229e660c45/8698896e-b7e4-5981-8f45-ae229e660c45_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2789960,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_cfddc7695b9dad422766223ff2472a32.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8698896e-b7e4-5981-8f45-ae229e660c45/8698896e-b7e4-5981-8f45-ae229e660c45_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76716,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_b5134ccc4fbcfb9a85cf7fbc110e8d4a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8698896e-b7e4-5981-8f45-ae229e660c45/8698896e-b7e4-5981-8f45-ae229e660c45_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81777,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_eb5736d24253d309ae5a0b0bb535406a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8698896e-b7e4-5981-8f45-ae229e660c45/8698896e-b7e4-5981-8f45-ae229e660c45_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64970,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_4cec1548a7fe94876c9c3796996a8d1b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8698896e-b7e4-5981-8f45-ae229e660c45/8698896e-b7e4-5981-8f45-ae229e660c45_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70341,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_d847b27bf7867670c10c5ecf53cff195.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8698896e-b7e4-5981-8f45-ae229e660c45/8698896e-b7e4-5981-8f45-ae229e660c45_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78001,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/78/73788f2310b0f58ad3af0c5d994f16f9/pa/RZ13611_6ecf6ca2cd36121de70c21707e88449f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-09-17',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2012}
2026-03-28 21:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ13611%27 HTTP/1.1" 200 None
2026-03-28 21:05:27 [auto1.it] INFO: Saving data for RZ13611: {'created_time': 1774731927.799208, 'last_price_update_time': 1774731927.799219, 'auction_closing_time': 1774883774.0}
2026-03-28 21:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RZ13611') HTTP/1.1" 204 0
2026-03-28 21:05:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 53f298c7-a98c-5c80-aad6-9cfd2cf5770a with identifier: WJ42513
2026-03-28 21:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 53f298c7-a98c-5c80-aad6-9cfd2cf5770a with identifier: WJ42513
2026-03-28 21:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 53f298c7-a98c-5c80-aad6-9cfd2cf5770a with identifier: WJ42513 to the API
2026-03-28 21:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WJ42513>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:48:28Z',
'fuel_type': 'diesel',
'id': '53f298c7-a98c-5c80-aad6-9cfd2cf5770a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ42513',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'BMW',
'model': '3er',
'odometer': 148995,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_7adacecf033f96f10ebf2e6b9e1812b9.jpg',
'https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_8a0ccceaa2159f5151aa32cd0f72d193.jpg',
'https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_e0e8273db6c2ab8dab7a3f4f118502d4.jpg',
'https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_afff0468eb853855df034b0c3018bdcf.jpg',
'https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_3ba5e3f0d91a28c5fa0674c43419ecf6.jpg',
'https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_0f117ae8134068d2019972a5a46bef06.jpg',
'https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_7a6abbee614a0c705c49e394e25aa6a9.jpg',
'https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_7b1e47974cda0278bcc2d83b512197a4.jpg',
'https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_cf5d7d4854352ab6d1433209fb55e5da.jpg',
'https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_b28861cc51a191456c802ac8163e9e9b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53f298c7-a98c-5c80-aad6-9cfd2cf5770a/53f298c7-a98c-5c80-aad6-9cfd2cf5770a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2702196,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_7adacecf033f96f10ebf2e6b9e1812b9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53f298c7-a98c-5c80-aad6-9cfd2cf5770a/53f298c7-a98c-5c80-aad6-9cfd2cf5770a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75577,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_8a0ccceaa2159f5151aa32cd0f72d193.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53f298c7-a98c-5c80-aad6-9cfd2cf5770a/53f298c7-a98c-5c80-aad6-9cfd2cf5770a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2572666,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_e0e8273db6c2ab8dab7a3f4f118502d4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53f298c7-a98c-5c80-aad6-9cfd2cf5770a/53f298c7-a98c-5c80-aad6-9cfd2cf5770a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65136,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_afff0468eb853855df034b0c3018bdcf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53f298c7-a98c-5c80-aad6-9cfd2cf5770a/53f298c7-a98c-5c80-aad6-9cfd2cf5770a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2689905,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_3ba5e3f0d91a28c5fa0674c43419ecf6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53f298c7-a98c-5c80-aad6-9cfd2cf5770a/53f298c7-a98c-5c80-aad6-9cfd2cf5770a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78039,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_0f117ae8134068d2019972a5a46bef06.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53f298c7-a98c-5c80-aad6-9cfd2cf5770a/53f298c7-a98c-5c80-aad6-9cfd2cf5770a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2477543,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_7a6abbee614a0c705c49e394e25aa6a9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53f298c7-a98c-5c80-aad6-9cfd2cf5770a/53f298c7-a98c-5c80-aad6-9cfd2cf5770a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2671920,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_7b1e47974cda0278bcc2d83b512197a4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53f298c7-a98c-5c80-aad6-9cfd2cf5770a/53f298c7-a98c-5c80-aad6-9cfd2cf5770a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2604461,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_cf5d7d4854352ab6d1433209fb55e5da.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53f298c7-a98c-5c80-aad6-9cfd2cf5770a/53f298c7-a98c-5c80-aad6-9cfd2cf5770a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2707981,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0e/05/0e057655205d0d9ec7e9d9096367ab2c/pa/WJ42513_b28861cc51a191456c802ac8163e9e9b.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-03-02',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3er 318d Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2017}
2026-03-28 21:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ42513%27 HTTP/1.1" 200 None
2026-03-28 21:05:28 [auto1.it] INFO: Saving data for WJ42513: {'created_time': 1774731928.140761, 'last_price_update_time': 1774731928.140773, 'auction_closing_time': 1774885708.0}
2026-03-28 21:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WJ42513') HTTP/1.1" 204 0
2026-03-28 21:05:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a9b3bc18-88f8-58f7-9ba9-b5f6a9323a70 with identifier: ZE02722
2026-03-28 21:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a9b3bc18-88f8-58f7-9ba9-b5f6a9323a70 with identifier: ZE02722
2026-03-28 21:05:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a9b3bc18-88f8-58f7-9ba9-b5f6a9323a70 with identifier: ZE02722 to the API
2026-03-28 21:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZE02722>
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:55:50Z',
'fuel_type': 'diesel',
'id': 'a9b3bc18-88f8-58f7-9ba9-b5f6a9323a70',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE02722',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 345879,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_b3e2124f4ec3824c75e9c470c925f455.jpg',
'https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_c2aae44bc7583cb8e85d4ba68c981852.jpg',
'https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_50273f4176304765e1caad72b2d0cde0.jpg',
'https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_09c3a6cb7530ca73deeec001df5fd6cc.jpg',
'https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_bb28df4429377fa75d52b58e8bd1b61b.jpg',
'https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_0bc968796e00d3a167fd52bec4687797.jpg',
'https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_aca9b4ee20e33c09190ae7c4808588cc.jpg',
'https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_c08decb96cc1d29f5fe0f24eb7c911df.jpg',
'https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_a83f98d2725490b2d58cac3c5d94d204.jpg',
'https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_9d59cf2ffa93835dbf689cbc741764c0.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b3bc18-88f8-58f7-9ba9-b5f6a9323a70/a9b3bc18-88f8-58f7-9ba9-b5f6a9323a70_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2904157,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_b3e2124f4ec3824c75e9c470c925f455.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b3bc18-88f8-58f7-9ba9-b5f6a9323a70/a9b3bc18-88f8-58f7-9ba9-b5f6a9323a70_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2828061,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_c2aae44bc7583cb8e85d4ba68c981852.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b3bc18-88f8-58f7-9ba9-b5f6a9323a70/a9b3bc18-88f8-58f7-9ba9-b5f6a9323a70_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2847487,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_50273f4176304765e1caad72b2d0cde0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b3bc18-88f8-58f7-9ba9-b5f6a9323a70/a9b3bc18-88f8-58f7-9ba9-b5f6a9323a70_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2618688,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_09c3a6cb7530ca73deeec001df5fd6cc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b3bc18-88f8-58f7-9ba9-b5f6a9323a70/a9b3bc18-88f8-58f7-9ba9-b5f6a9323a70_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2637768,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_bb28df4429377fa75d52b58e8bd1b61b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b3bc18-88f8-58f7-9ba9-b5f6a9323a70/a9b3bc18-88f8-58f7-9ba9-b5f6a9323a70_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2744382,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_0bc968796e00d3a167fd52bec4687797.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b3bc18-88f8-58f7-9ba9-b5f6a9323a70/a9b3bc18-88f8-58f7-9ba9-b5f6a9323a70_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2913183,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_aca9b4ee20e33c09190ae7c4808588cc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b3bc18-88f8-58f7-9ba9-b5f6a9323a70/a9b3bc18-88f8-58f7-9ba9-b5f6a9323a70_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2638310,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_c08decb96cc1d29f5fe0f24eb7c911df.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b3bc18-88f8-58f7-9ba9-b5f6a9323a70/a9b3bc18-88f8-58f7-9ba9-b5f6a9323a70_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2772795,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_a83f98d2725490b2d58cac3c5d94d204.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b3bc18-88f8-58f7-9ba9-b5f6a9323a70/a9b3bc18-88f8-58f7-9ba9-b5f6a9323a70_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2291105,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img78/86/7886187874a91ab96522f7858ae9b393/pa/ZE02722_9d59cf2ffa93835dbf689cbc741764c0.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-02-27',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A5 Sportback 2.0 TDI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2018}
2026-03-28 21:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE02722%27 HTTP/1.1" 200 None
2026-03-28 21:05:28 [auto1.it] INFO: Saving data for ZE02722: {'created_time': 1774731928.450561, 'last_price_update_time': 1774731928.450572, 'auction_closing_time': 1774886150.0}
2026-03-28 21:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZE02722') HTTP/1.1" 204 0
2026-03-28 21:05:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 52cdef6d-01a3-5d4f-a27d-287e39353651 with identifier: RF53509
2026-03-28 21:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 52cdef6d-01a3-5d4f-a27d-287e39353651 with identifier: RF53509
2026-03-28 21:05:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 52cdef6d-01a3-5d4f-a27d-287e39353651 with identifier: RF53509 to the API
2026-03-28 21:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RF53509>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:38:55Z',
'fuel_type': 'diesel',
'id': '52cdef6d-01a3-5d4f-a27d-287e39353651',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF53509',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Citroen',
'model': 'C4 Aircross',
'odometer': 202205,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_35fa754f6f03301c12f839da5112d8ea.jpg',
'https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_4b00a0293dd81b1da99eae3f0c2f3de4.jpg',
'https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_49fcb7e3684109fe5dde894f7786bb77.jpg',
'https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_c67910be4d313a5ce7cc790793defd27.jpg',
'https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_764abae7a12f9e68137fffbb2f77835e.jpg',
'https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_a754a060accc1715b0cfa90c29524e6c.jpg',
'https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_71b3f484093325cef80449659a16b107.jpg',
'https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_5f3447aaa71a34ea22b8cb55c0aefd86.jpg',
'https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_857443d324f37baf325cf91f65d0abc0.jpg',
'https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_367fae2834b6d493eafe0b415b0ffbba.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52cdef6d-01a3-5d4f-a27d-287e39353651/52cdef6d-01a3-5d4f-a27d-287e39353651_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3607934,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_35fa754f6f03301c12f839da5112d8ea.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52cdef6d-01a3-5d4f-a27d-287e39353651/52cdef6d-01a3-5d4f-a27d-287e39353651_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97282,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_4b00a0293dd81b1da99eae3f0c2f3de4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52cdef6d-01a3-5d4f-a27d-287e39353651/52cdef6d-01a3-5d4f-a27d-287e39353651_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111995,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_49fcb7e3684109fe5dde894f7786bb77.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52cdef6d-01a3-5d4f-a27d-287e39353651/52cdef6d-01a3-5d4f-a27d-287e39353651_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101522,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_c67910be4d313a5ce7cc790793defd27.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52cdef6d-01a3-5d4f-a27d-287e39353651/52cdef6d-01a3-5d4f-a27d-287e39353651_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104930,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_764abae7a12f9e68137fffbb2f77835e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52cdef6d-01a3-5d4f-a27d-287e39353651/52cdef6d-01a3-5d4f-a27d-287e39353651_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113703,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_a754a060accc1715b0cfa90c29524e6c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52cdef6d-01a3-5d4f-a27d-287e39353651/52cdef6d-01a3-5d4f-a27d-287e39353651_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89096,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_71b3f484093325cef80449659a16b107.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52cdef6d-01a3-5d4f-a27d-287e39353651/52cdef6d-01a3-5d4f-a27d-287e39353651_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79610,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_5f3447aaa71a34ea22b8cb55c0aefd86.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52cdef6d-01a3-5d4f-a27d-287e39353651/52cdef6d-01a3-5d4f-a27d-287e39353651_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83307,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_857443d324f37baf325cf91f65d0abc0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52cdef6d-01a3-5d4f-a27d-287e39353651/52cdef6d-01a3-5d4f-a27d-287e39353651_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88605,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/c8/f8c8649f4f88f08f1b866ac29486640b/pa/RF53509_367fae2834b6d493eafe0b415b0ffbba.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-07-30',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 Aircross 1.6 HDi Exclusive 4x2',
'transmission': 'manual',
'trim': 'Exclusive 4x2',
'year': 2012}
2026-03-28 21:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF53509%27 HTTP/1.1" 200 None
2026-03-28 21:05:28 [auto1.it] INFO: Saving data for RF53509: {'created_time': 1774731928.767813, 'last_price_update_time': 1774731928.767822, 'auction_closing_time': 1774885135.0}
2026-03-28 21:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RF53509') HTTP/1.1" 204 0
2026-03-28 21:05:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 88d31c13-ba9d-509e-8305-89eebf81f62a with identifier: NP45555
2026-03-28 21:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 21:05:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-28 21:05:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 21:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 21:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 88d31c13-ba9d-509e-8305-89eebf81f62a with identifier: NP45555
2026-03-28 21:05:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 88d31c13-ba9d-509e-8305-89eebf81f62a with identifier: NP45555 to the API
2026-03-28 21:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:20:34Z',
'fuel_type': 'diesel',
'id': '88d31c13-ba9d-509e-8305-89eebf81f62a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP45555',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Rifter',
'odometer': 171028,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-18',
'seller_name': None,
'title': 'Peugeot Rifter 1.5 Blue-HDi GT Line',
'transmission': 'manual',
'trim': 'GT Line',
'year': 2019}
2026-03-28 21:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP45555%27 HTTP/1.1" 200 None
2026-03-28 21:05:29 [auto1.it] INFO: Saving data for NP45555: {'auction_closing_time': 1774884034.0, 'created_time': 1773134785.368685, 'last_price_update_time': 1774731929.235397}
2026-03-28 21:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NP45555') HTTP/1.1" 204 0
2026-03-28 21:05:29 [auto1.it] INFO: Found listing with ID: LE11885
2026-03-28 21:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE11885%27 HTTP/1.1" 200 None
2026-03-28 21:05:29 [auto1.it] INFO: Scrape type for LE11885: 0
2026-03-28 21:05:29 [auto1.it] INFO: Found listing with ID: EW80133
2026-03-28 21:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW80133%27 HTTP/1.1" 200 None
2026-03-28 21:05:29 [auto1.it] INFO: Scrape type for EW80133: 1
2026-03-28 21:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EK01014/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:29 [auto1.it] INFO: Found listing with ID: DB86833
2026-03-28 21:05:29 [auto1.it] INFO: Found listing with ID: VF83639
2026-03-28 21:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF83639%27 HTTP/1.1" 200 None
2026-03-28 21:05:29 [auto1.it] INFO: Scrape type for VF83639: 1
2026-03-28 21:05:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:29 [auto1.it] INFO: Found listing with ID: JP63485
2026-03-28 21:05:29 [auto1.it] INFO: Found listing with ID: PE22085
2026-03-28 21:05:29 [auto1.it] INFO: Found listing with ID: AC12689
2026-03-28 21:05:29 [auto1.it] INFO: Found listing with ID: KK08991
2026-03-28 21:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK08991%27 HTTP/1.1" 200 None
2026-03-28 21:05:29 [auto1.it] INFO: Scrape type for KK08991: 1
2026-03-28 21:05:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:29 [auto1.it] INFO: Found listing with ID: NJ15500
2026-03-28 21:05:29 [auto1.it] INFO: Found listing with ID: JU37769
2026-03-28 21:05:29 [auto1.it] INFO: Found listing with ID: LA80285
2026-03-28 21:05:29 [auto1.it] INFO: Found listing with ID: LM41534
2026-03-28 21:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM41534%27 HTTP/1.1" 200 None
2026-03-28 21:05:29 [auto1.it] INFO: Scrape type for LM41534: 0
2026-03-28 21:05:29 [auto1.it] INFO: Found listing with ID: UK25874
2026-03-28 21:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK25874%27 HTTP/1.1" 200 None
2026-03-28 21:05:29 [auto1.it] INFO: Scrape type for UK25874: 1
2026-03-28 21:05:29 [auto1.it] INFO: Found listing with ID: LV20949
2026-03-28 21:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV20949%27 HTTP/1.1" 200 None
2026-03-28 21:05:29 [auto1.it] INFO: Scrape type for LV20949: 2
2026-03-28 21:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a1a05e8-48af-5642-bd24-1f2202714a4d with identifier: LV20949
2026-03-28 21:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a1a05e8-48af-5642-bd24-1f2202714a4d with scrape type 2
2026-03-28 21:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a1a05e8-48af-5642-bd24-1f2202714a4d with scrape type 2
2026-03-28 21:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5a1a05e8-48af-5642-bd24-1f2202714a4d, identifier: LV20949
2026-03-28 21:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5a1a05e8-48af-5642-bd24-1f2202714a4d with identifier: LV20949
2026-03-28 21:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5a1a05e8-48af-5642-bd24-1f2202714a4d with identifier: LV20949
2026-03-28 21:05:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5a1a05e8-48af-5642-bd24-1f2202714a4d with identifier: LV20949 to the API
2026-03-28 21:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:49:09Z',
'fuel_type': 'diesel',
'id': '5a1a05e8-48af-5642-bd24-1f2202714a4d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV20949',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 227987,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-12-09',
'seller_name': None,
'title': 'Audi A6 2.5 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2003}
2026-03-28 21:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV20949%27 HTTP/1.1" 200 None
2026-03-28 21:05:29 [auto1.it] INFO: Saving data for LV20949: {'auction_closing_time': 1774885749.0, 'created_time': 1772626026.010713, 'last_price_update_time': 1774731929.859474}
2026-03-28 21:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LV20949') HTTP/1.1" 204 0
2026-03-28 21:05:29 [auto1.it] INFO: Found listing with ID: PB14031
2026-03-28 21:05:29 [auto1.it] INFO: Found listing with ID: YD46190
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD46190%27 HTTP/1.1" 200 None
2026-03-28 21:05:30 [auto1.it] INFO: Scrape type for YD46190: 0
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: BP59545
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: US42109
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: WL47610
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: TE89149
2026-03-28 21:05:30 [auto1.it] INFO: Channel: 24h | Page: 3 | totalHits: 2224 | hits on page: 40
2026-03-28 21:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PZ73460/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: WV37243
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV37243%27 HTTP/1.1" 200 None
2026-03-28 21:05:30 [auto1.it] INFO: Scrape type for WV37243: 0
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: TJ46359
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: FJ55026
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: KR30691
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: LU63689
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: GW87454
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: PH50557
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: JV01871
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: ZU90701
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: WK43313
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK43313%27 HTTP/1.1" 200 None
2026-03-28 21:05:30 [auto1.it] INFO: Scrape type for WK43313: 0
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: FS14402
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: UV07226
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV07226%27 HTTP/1.1" 200 None
2026-03-28 21:05:30 [auto1.it] INFO: Scrape type for UV07226: 0
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: DB68692
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: DC45028
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC45028%27 HTTP/1.1" 200 None
2026-03-28 21:05:30 [auto1.it] INFO: Scrape type for DC45028: 0
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: BD73790
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD73790%27 HTTP/1.1" 200 None
2026-03-28 21:05:30 [auto1.it] INFO: Scrape type for BD73790: 0
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: SL28261
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL28261%27 HTTP/1.1" 200 None
2026-03-28 21:05:30 [auto1.it] INFO: Scrape type for SL28261: 0
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: XC65612
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: PH70338
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH70338%27 HTTP/1.1" 200 None
2026-03-28 21:05:30 [auto1.it] INFO: Scrape type for PH70338: 0
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: YD99116
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD99116%27 HTTP/1.1" 200 None
2026-03-28 21:05:30 [auto1.it] INFO: Scrape type for YD99116: 0
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: XC79515
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC79515%27 HTTP/1.1" 200 None
2026-03-28 21:05:30 [auto1.it] INFO: Scrape type for XC79515: 0
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: RS77350
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS77350%27 HTTP/1.1" 200 None
2026-03-28 21:05:30 [auto1.it] INFO: Scrape type for RS77350: 0
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: NK56802
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: ET21203
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET21203%27 HTTP/1.1" 200 None
2026-03-28 21:05:30 [auto1.it] INFO: Scrape type for ET21203: 0
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: HZ70208
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ70208%27 HTTP/1.1" 200 None
2026-03-28 21:05:30 [auto1.it] INFO: Scrape type for HZ70208: 0
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: BG99585
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG99585%27 HTTP/1.1" 200 None
2026-03-28 21:05:30 [auto1.it] INFO: Scrape type for BG99585: 0
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: JP32854
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP32854%27 HTTP/1.1" 200 None
2026-03-28 21:05:30 [auto1.it] INFO: Scrape type for JP32854: 2
2026-03-28 21:05:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4fd9ca8-cef7-5baa-b3ad-5a41fe238043 with identifier: JP32854
2026-03-28 21:05:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4fd9ca8-cef7-5baa-b3ad-5a41fe238043 with scrape type 2
2026-03-28 21:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4fd9ca8-cef7-5baa-b3ad-5a41fe238043 with scrape type 2
2026-03-28 21:05:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c4fd9ca8-cef7-5baa-b3ad-5a41fe238043, identifier: JP32854
2026-03-28 21:05:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c4fd9ca8-cef7-5baa-b3ad-5a41fe238043 with identifier: JP32854
2026-03-28 21:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c4fd9ca8-cef7-5baa-b3ad-5a41fe238043 with identifier: JP32854
2026-03-28 21:05:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c4fd9ca8-cef7-5baa-b3ad-5a41fe238043 with identifier: JP32854 to the API
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:57:11Z',
'fuel_type': 'diesel',
'id': 'c4fd9ca8-cef7-5baa-b3ad-5a41fe238043',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP32854',
'listing': 'auction',
'make': 'Fiat',
'model': 'Doblo',
'odometer': 169300,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-12-16',
'seller_name': None,
'title': 'Fiat Doblo 1.3 JTD Basis Kasten',
'transmission': 'manual',
'trim': 'Basis Kasten',
'year': 2009}
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP32854%27 HTTP/1.1" 200 None
2026-03-28 21:05:30 [auto1.it] INFO: Saving data for JP32854: {'auction_closing_time': 1774886231.0, 'created_time': 1774533961.405738, 'last_price_update_time': 1774731930.718804}
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JP32854') HTTP/1.1" 204 0
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: FV19054
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV19054%27 HTTP/1.1" 200 None
2026-03-28 21:05:30 [auto1.it] INFO: Scrape type for FV19054: 0
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: VX82839
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: PA28005
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: PT96186
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: KC73163
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC73163%27 HTTP/1.1" 200 None
2026-03-28 21:05:30 [auto1.it] INFO: Scrape type for KC73163: 0
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: MN68461
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: RE99850
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE99850%27 HTTP/1.1" 200 None
2026-03-28 21:05:30 [auto1.it] INFO: Scrape type for RE99850: 0
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: UJ66117
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UJ66117%27 HTTP/1.1" 200 None
2026-03-28 21:05:30 [auto1.it] INFO: Scrape type for UJ66117: 0
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: YA54300
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA54300%27 HTTP/1.1" 200 None
2026-03-28 21:05:30 [auto1.it] INFO: Scrape type for YA54300: 0
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: CU15371
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU15371%27 HTTP/1.1" 200 None
2026-03-28 21:05:30 [auto1.it] INFO: Scrape type for CU15371: 0
2026-03-28 21:05:30 [auto1.it] INFO: Found listing with ID: JP92326
2026-03-28 21:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP92326%27 HTTP/1.1" 200 None
2026-03-28 21:05:31 [auto1.it] INFO: Scrape type for JP92326: 0
2026-03-28 21:05:31 [auto1.it] INFO: Found listing with ID: XB62766
2026-03-28 21:05:31 [auto1.it] INFO: Found listing with ID: AB01371
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AB01371%27 HTTP/1.1" 200 None
2026-03-28 21:05:31 [auto1.it] INFO: Scrape type for AB01371: 0
2026-03-28 21:05:31 [auto1.it] INFO: Found listing with ID: MR45258
2026-03-28 21:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RX80413> (referer: https://www.auto1.com/v1/car-details-view/RX80413/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XE77432/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BZ50824/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PU50365/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49522c97-b589-5432-a887-7a3da0f74304 with identifier: RX80413
2026-03-28 21:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49522c97-b589-5432-a887-7a3da0f74304 with scrape type 1
2026-03-28 21:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 49522c97-b589-5432-a887-7a3da0f74304
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F32%252F22322d846458aad14d7e5ec4e6cb8c7a%252Fpa%252FRX80413_c3572f96075c803928a717ebe02d7ec6.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_c3572f96075c803928a717ebe02d7ec6.jpg not downloaded yet
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F32%252F22322d846458aad14d7e5ec4e6cb8c7a%252Fpa%252FRX80413_7c67b0f547d995b252762ca3ed2056d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_7c67b0f547d995b252762ca3ed2056d5.jpg not downloaded yet
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F32%252F22322d846458aad14d7e5ec4e6cb8c7a%252Fpa%252FRX80413_6abdcb874ae49e191e17173c04ea85ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_6abdcb874ae49e191e17173c04ea85ed.jpg not downloaded yet
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F32%252F22322d846458aad14d7e5ec4e6cb8c7a%252Fpa%252FRX80413_870ebda11d7d6364ebdb083535e69d3b.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_870ebda11d7d6364ebdb083535e69d3b.jpg not downloaded yet
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F32%252F22322d846458aad14d7e5ec4e6cb8c7a%252Fpa%252FRX80413_82844c70e1e08e16e695e567e871df08.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_82844c70e1e08e16e695e567e871df08.jpg not downloaded yet
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F32%252F22322d846458aad14d7e5ec4e6cb8c7a%252Fpa%252FRX80413_aa5c403f119b7586aa82012662a63bce.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_aa5c403f119b7586aa82012662a63bce.jpg not downloaded yet
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F32%252F22322d846458aad14d7e5ec4e6cb8c7a%252Fpa%252FRX80413_960300bcc19242215fe2e754a78964db.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_960300bcc19242215fe2e754a78964db.jpg not downloaded yet
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F32%252F22322d846458aad14d7e5ec4e6cb8c7a%252Fpa%252FRX80413_eb9d9b0e7de3c62b40f96435269d9380.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_eb9d9b0e7de3c62b40f96435269d9380.jpg not downloaded yet
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F32%252F22322d846458aad14d7e5ec4e6cb8c7a%252Fpa%252FRX80413_c7d9b98e1ec6ee74d0f9edbc2fa1dcf9.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_c7d9b98e1ec6ee74d0f9edbc2fa1dcf9.jpg not downloaded yet
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F32%252F22322d846458aad14d7e5ec4e6cb8c7a%252Fpa%252FRX80413_97688bc3cc4b9ecea28ff618e983f022.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_97688bc3cc4b9ecea28ff618e983f022.jpg not downloaded yet
2026-03-28 21:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_c3572f96075c803928a717ebe02d7ec6.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_870ebda11d7d6364ebdb083535e69d3b.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_c7d9b98e1ec6ee74d0f9edbc2fa1dcf9.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-28 21:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-28 21:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b842da310>
2026-03-28 21:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2122
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49522c97-b589-5432-a887-7a3da0f74304/49522c97-b589-5432-a887-7a3da0f74304_image_0.jpg HTTP/1.1" 201 0
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F32%252F22322d846458aad14d7e5ec4e6cb8c7a%252Fpa%252FRX80413_c3572f96075c803928a717ebe02d7ec6.jpg') HTTP/1.1" 204 0
2026-03-28 21:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_c3572f96075c803928a717ebe02d7ec6.jpg saved to cache
2026-03-28 21:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49522c97-b589-5432-a887-7a3da0f74304
2026-03-28 21:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_97688bc3cc4b9ecea28ff618e983f022.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_eb9d9b0e7de3c62b40f96435269d9380.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_6abdcb874ae49e191e17173c04ea85ed.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VF83639/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KK08991/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UK25874/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8438ea50>
2026-03-28 21:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49522c97-b589-5432-a887-7a3da0f74304/49522c97-b589-5432-a887-7a3da0f74304_image_3.jpg HTTP/1.1" 201 0
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F32%252F22322d846458aad14d7e5ec4e6cb8c7a%252Fpa%252FRX80413_870ebda11d7d6364ebdb083535e69d3b.jpg') HTTP/1.1" 204 0
2026-03-28 21:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_870ebda11d7d6364ebdb083535e69d3b.jpg saved to cache
2026-03-28 21:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 49522c97-b589-5432-a887-7a3da0f74304
2026-03-28 21:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b842b7250>
2026-03-28 21:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49522c97-b589-5432-a887-7a3da0f74304/49522c97-b589-5432-a887-7a3da0f74304_image_8.jpg HTTP/1.1" 201 0
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F32%252F22322d846458aad14d7e5ec4e6cb8c7a%252Fpa%252FRX80413_c7d9b98e1ec6ee74d0f9edbc2fa1dcf9.jpg') HTTP/1.1" 204 0
2026-03-28 21:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_c7d9b98e1ec6ee74d0f9edbc2fa1dcf9.jpg saved to cache
2026-03-28 21:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 49522c97-b589-5432-a887-7a3da0f74304
2026-03-28 21:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84216a10>
2026-03-28 21:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49522c97-b589-5432-a887-7a3da0f74304/49522c97-b589-5432-a887-7a3da0f74304_image_9.jpg HTTP/1.1" 201 0
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F32%252F22322d846458aad14d7e5ec4e6cb8c7a%252Fpa%252FRX80413_97688bc3cc4b9ecea28ff618e983f022.jpg') HTTP/1.1" 204 0
2026-03-28 21:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_97688bc3cc4b9ecea28ff618e983f022.jpg saved to cache
2026-03-28 21:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 49522c97-b589-5432-a887-7a3da0f74304
2026-03-28 21:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8436f690>
2026-03-28 21:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49522c97-b589-5432-a887-7a3da0f74304/49522c97-b589-5432-a887-7a3da0f74304_image_7.jpg HTTP/1.1" 201 0
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F32%252F22322d846458aad14d7e5ec4e6cb8c7a%252Fpa%252FRX80413_eb9d9b0e7de3c62b40f96435269d9380.jpg') HTTP/1.1" 204 0
2026-03-28 21:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_eb9d9b0e7de3c62b40f96435269d9380.jpg saved to cache
2026-03-28 21:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 49522c97-b589-5432-a887-7a3da0f74304
2026-03-28 21:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8427ae90>
2026-03-28 21:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49522c97-b589-5432-a887-7a3da0f74304/49522c97-b589-5432-a887-7a3da0f74304_image_2.jpg HTTP/1.1" 201 0
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F32%252F22322d846458aad14d7e5ec4e6cb8c7a%252Fpa%252FRX80413_6abdcb874ae49e191e17173c04ea85ed.jpg') HTTP/1.1" 204 0
2026-03-28 21:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_6abdcb874ae49e191e17173c04ea85ed.jpg saved to cache
2026-03-28 21:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 49522c97-b589-5432-a887-7a3da0f74304
2026-03-28 21:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_aa5c403f119b7586aa82012662a63bce.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_960300bcc19242215fe2e754a78964db.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PZ73460> (referer: https://www.auto1.com/v1/car-details-view/PZ73460/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EK01014> (referer: https://www.auto1.com/v1/car-details-view/EK01014/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:32 [auto1.it] INFO: Channel: 24h | Page: 4 | totalHits: 2224 | hits on page: 40
2026-03-28 21:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_82844c70e1e08e16e695e567e871df08.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:05:32 [auto1.it] INFO: Found listing with ID: TU59296
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU59296%27 HTTP/1.1" 200 None
2026-03-28 21:05:32 [auto1.it] INFO: Scrape type for TU59296: 0
2026-03-28 21:05:32 [auto1.it] INFO: Found listing with ID: FN81856
2026-03-28 21:05:32 [auto1.it] INFO: Found listing with ID: AD01687
2026-03-28 21:05:32 [auto1.it] INFO: Found listing with ID: RM66107
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM66107%27 HTTP/1.1" 200 None
2026-03-28 21:05:32 [auto1.it] INFO: Scrape type for RM66107: 0
2026-03-28 21:05:32 [auto1.it] INFO: Found listing with ID: CK86990
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK86990%27 HTTP/1.1" 200 None
2026-03-28 21:05:32 [auto1.it] INFO: Scrape type for CK86990: 0
2026-03-28 21:05:32 [auto1.it] INFO: Found listing with ID: AY12786
2026-03-28 21:05:32 [auto1.it] INFO: Found listing with ID: XD81326
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD81326%27 HTTP/1.1" 200 None
2026-03-28 21:05:32 [auto1.it] INFO: Scrape type for XD81326: 0
2026-03-28 21:05:32 [auto1.it] INFO: Found listing with ID: ED09945
2026-03-28 21:05:32 [auto1.it] INFO: Found listing with ID: LK74969
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK74969%27 HTTP/1.1" 200 None
2026-03-28 21:05:32 [auto1.it] INFO: Scrape type for LK74969: 0
2026-03-28 21:05:32 [auto1.it] INFO: Found listing with ID: PW94940
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW94940%27 HTTP/1.1" 200 None
2026-03-28 21:05:32 [auto1.it] INFO: Scrape type for PW94940: 0
2026-03-28 21:05:32 [auto1.it] INFO: Found listing with ID: UH56050
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH56050%27 HTTP/1.1" 200 None
2026-03-28 21:05:32 [auto1.it] INFO: Scrape type for UH56050: 0
2026-03-28 21:05:32 [auto1.it] INFO: Found listing with ID: VX86460
2026-03-28 21:05:32 [auto1.it] INFO: Found listing with ID: LF91623
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LF91623%27 HTTP/1.1" 200 None
2026-03-28 21:05:32 [auto1.it] INFO: Scrape type for LF91623: 0
2026-03-28 21:05:32 [auto1.it] INFO: Found listing with ID: WE55630
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE55630%27 HTTP/1.1" 200 None
2026-03-28 21:05:32 [auto1.it] INFO: Scrape type for WE55630: 0
2026-03-28 21:05:32 [auto1.it] INFO: Found listing with ID: XT06455
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT06455%27 HTTP/1.1" 200 None
2026-03-28 21:05:32 [auto1.it] INFO: Scrape type for XT06455: 0
2026-03-28 21:05:32 [auto1.it] INFO: Found listing with ID: DD62614
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD62614%27 HTTP/1.1" 200 None
2026-03-28 21:05:32 [auto1.it] INFO: Scrape type for DD62614: 2
2026-03-28 21:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58295d4d-7d49-55d3-94fe-623ed2ff4bb1 with identifier: DD62614
2026-03-28 21:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58295d4d-7d49-55d3-94fe-623ed2ff4bb1 with scrape type 2
2026-03-28 21:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58295d4d-7d49-55d3-94fe-623ed2ff4bb1 with scrape type 2
2026-03-28 21:05:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 58295d4d-7d49-55d3-94fe-623ed2ff4bb1, identifier: DD62614
2026-03-28 21:05:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 58295d4d-7d49-55d3-94fe-623ed2ff4bb1 with identifier: DD62614
2026-03-28 21:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 58295d4d-7d49-55d3-94fe-623ed2ff4bb1 with identifier: DD62614
2026-03-28 21:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 58295d4d-7d49-55d3-94fe-623ed2ff4bb1 with identifier: DD62614 to the API
2026-03-28 21:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:15:48Z',
'fuel_type': 'diesel',
'id': '58295d4d-7d49-55d3-94fe-623ed2ff4bb1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD62614',
'listing': 'auction',
'make': 'Chevrolet',
'model': 'Captiva',
'odometer': 174701,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-06-21',
'seller_name': None,
'title': 'Chevrolet Captiva 2.2 Diesel D LTZ 4WD',
'transmission': 'automatic',
'trim': 'D LTZ 4WD',
'year': 2011}
2026-03-28 21:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD62614%27 HTTP/1.1" 200 None
2026-03-28 21:05:33 [auto1.it] INFO: Saving data for DD62614: {'auction_closing_time': 1774883748.0, 'created_time': 1774533956.199892, 'last_price_update_time': 1774731933.125613}
2026-03-28 21:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DD62614') HTTP/1.1" 204 0
2026-03-28 21:05:33 [auto1.it] INFO: Found listing with ID: BA90157
2026-03-28 21:05:33 [auto1.it] INFO: Found listing with ID: AB06670
2026-03-28 21:05:33 [auto1.it] INFO: Found listing with ID: LV99150
2026-03-28 21:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV99150%27 HTTP/1.1" 200 None
2026-03-28 21:05:33 [auto1.it] INFO: Scrape type for LV99150: 0
2026-03-28 21:05:33 [auto1.it] INFO: Found listing with ID: VC44140
2026-03-28 21:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC44140%27 HTTP/1.1" 200 None
2026-03-28 21:05:33 [auto1.it] INFO: Scrape type for VC44140: 0
2026-03-28 21:05:33 [auto1.it] INFO: Found listing with ID: LM08573
2026-03-28 21:05:33 [auto1.it] INFO: Found listing with ID: KV39692
2026-03-28 21:05:33 [auto1.it] INFO: Found listing with ID: UL45556
2026-03-28 21:05:33 [auto1.it] INFO: Found listing with ID: SG91000
2026-03-28 21:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG91000%27 HTTP/1.1" 200 None
2026-03-28 21:05:33 [auto1.it] INFO: Scrape type for SG91000: 0
2026-03-28 21:05:33 [auto1.it] INFO: Found listing with ID: JP22966
2026-03-28 21:05:33 [auto1.it] INFO: Found listing with ID: CK12538
2026-03-28 21:05:33 [auto1.it] INFO: Found listing with ID: AA32249
2026-03-28 21:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AA32249%27 HTTP/1.1" 200 None
2026-03-28 21:05:33 [auto1.it] INFO: Scrape type for AA32249: 0
2026-03-28 21:05:33 [auto1.it] INFO: Found listing with ID: YV19719
2026-03-28 21:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV19719%27 HTTP/1.1" 200 None
2026-03-28 21:05:33 [auto1.it] INFO: Scrape type for YV19719: 0
2026-03-28 21:05:33 [auto1.it] INFO: Found listing with ID: PW56521
2026-03-28 21:05:33 [auto1.it] INFO: Found listing with ID: ZZ46834
2026-03-28 21:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ46834%27 HTTP/1.1" 200 None
2026-03-28 21:05:33 [auto1.it] INFO: Scrape type for ZZ46834: 0
2026-03-28 21:05:33 [auto1.it] INFO: Found listing with ID: SV37675
2026-03-28 21:05:33 [auto1.it] INFO: Found listing with ID: CX68845
2026-03-28 21:05:33 [auto1.it] INFO: Found listing with ID: BF69187
2026-03-28 21:05:33 [auto1.it] INFO: Found listing with ID: EV65529
2026-03-28 21:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV65529%27 HTTP/1.1" 200 None
2026-03-28 21:05:33 [auto1.it] INFO: Scrape type for EV65529: 2
2026-03-28 21:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d18ed95-6b2c-5ceb-8699-e1b9abab14f3 with identifier: EV65529
2026-03-28 21:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d18ed95-6b2c-5ceb-8699-e1b9abab14f3 with scrape type 2
2026-03-28 21:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d18ed95-6b2c-5ceb-8699-e1b9abab14f3 with scrape type 2
2026-03-28 21:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6d18ed95-6b2c-5ceb-8699-e1b9abab14f3, identifier: EV65529
2026-03-28 21:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_7c67b0f547d995b252762ca3ed2056d5.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6d18ed95-6b2c-5ceb-8699-e1b9abab14f3 with identifier: EV65529
2026-03-28 21:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 21:05:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 21:05:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 21:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 21:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6d18ed95-6b2c-5ceb-8699-e1b9abab14f3 with identifier: EV65529
2026-03-28 21:05:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6d18ed95-6b2c-5ceb-8699-e1b9abab14f3 with identifier: EV65529 to the API
2026-03-28 21:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:24:01Z',
'fuel_type': 'petrol',
'id': '6d18ed95-6b2c-5ceb-8699-e1b9abab14f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV65529',
'listing': 'auction',
'make': 'Opel',
'model': 'Adam',
'odometer': 88252,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-30',
'seller_name': None,
'title': 'Opel Adam 1.2 Glam',
'transmission': 'manual',
'trim': 'Glam',
'year': 2019}
2026-03-28 21:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV65529%27 HTTP/1.1" 200 None
2026-03-28 21:05:33 [auto1.it] INFO: Saving data for EV65529: {'auction_closing_time': 1774884241.0, 'created_time': 1774127304.761664, 'last_price_update_time': 1774731933.989784}
2026-03-28 21:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EV65529') HTTP/1.1" 204 0
2026-03-28 21:05:34 [auto1.it] INFO: Found listing with ID: YW82008
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW82008%27 HTTP/1.1" 200 None
2026-03-28 21:05:34 [auto1.it] INFO: Scrape type for YW82008: 0
2026-03-28 21:05:34 [auto1.it] INFO: Found listing with ID: TH21432
2026-03-28 21:05:34 [auto1.it] INFO: Found listing with ID: MH72386
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH72386%27 HTTP/1.1" 200 None
2026-03-28 21:05:34 [auto1.it] INFO: Scrape type for MH72386: 0
2026-03-28 21:05:34 [auto1.it] INFO: Found listing with ID: CR81411
2026-03-28 21:05:34 [auto1.it] INFO: Found listing with ID: YF20115
2026-03-28 21:05:34 [auto1.it] INFO: Found listing with ID: NN80859
2026-03-28 21:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EW80133/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84289e90>
2026-03-28 21:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49522c97-b589-5432-a887-7a3da0f74304/49522c97-b589-5432-a887-7a3da0f74304_image_5.jpg HTTP/1.1" 201 0
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F32%252F22322d846458aad14d7e5ec4e6cb8c7a%252Fpa%252FRX80413_aa5c403f119b7586aa82012662a63bce.jpg') HTTP/1.1" 204 0
2026-03-28 21:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_aa5c403f119b7586aa82012662a63bce.jpg saved to cache
2026-03-28 21:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 49522c97-b589-5432-a887-7a3da0f74304
2026-03-28 21:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8428ca90>
2026-03-28 21:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49522c97-b589-5432-a887-7a3da0f74304/49522c97-b589-5432-a887-7a3da0f74304_image_6.jpg HTTP/1.1" 201 0
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F32%252F22322d846458aad14d7e5ec4e6cb8c7a%252Fpa%252FRX80413_960300bcc19242215fe2e754a78964db.jpg') HTTP/1.1" 204 0
2026-03-28 21:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_960300bcc19242215fe2e754a78964db.jpg saved to cache
2026-03-28 21:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 49522c97-b589-5432-a887-7a3da0f74304
2026-03-28 21:05:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0f5ceda-e1cf-54bd-a1fb-e8f939247828 with identifier: PZ73460
2026-03-28 21:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0f5ceda-e1cf-54bd-a1fb-e8f939247828 with scrape type 1
2026-03-28 21:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c0f5ceda-e1cf-54bd-a1fb-e8f939247828
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F33%252Faa331605640af40fb3c49d0b970b6227%252Fpa%252FPZ73460_24e787638cc2242e96e7a41b5c5364e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_24e787638cc2242e96e7a41b5c5364e5.jpg already downloaded
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F33%252Faa331605640af40fb3c49d0b970b6227%252Fpa%252FPZ73460_f0d355834785ee9d7d2ce936ae24cc64.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_f0d355834785ee9d7d2ce936ae24cc64.jpg already downloaded
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F33%252Faa331605640af40fb3c49d0b970b6227%252Fpa%252FPZ73460_a807c5e0d5b0ae3a36fb95434ac8160f.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_a807c5e0d5b0ae3a36fb95434ac8160f.jpg already downloaded
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F33%252Faa331605640af40fb3c49d0b970b6227%252Fpa%252FPZ73460_0bf7034205fbeaa1f9d94884d9a29ab6.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_0bf7034205fbeaa1f9d94884d9a29ab6.jpg already downloaded
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F33%252Faa331605640af40fb3c49d0b970b6227%252Fpa%252FPZ73460_6f8a066c770aea4534ed51e8e633888e.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_6f8a066c770aea4534ed51e8e633888e.jpg already downloaded
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F33%252Faa331605640af40fb3c49d0b970b6227%252Fpa%252FPZ73460_2552e2b2ee39ec6043400164622a583a.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_2552e2b2ee39ec6043400164622a583a.jpg already downloaded
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F33%252Faa331605640af40fb3c49d0b970b6227%252Fpa%252FPZ73460_d4c522708f78fd9d3aa64dcf39c5ceac.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_d4c522708f78fd9d3aa64dcf39c5ceac.jpg already downloaded
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F33%252Faa331605640af40fb3c49d0b970b6227%252Fpa%252FPZ73460_d8ef336dd231ea25762915a24dd474f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_d8ef336dd231ea25762915a24dd474f4.jpg already downloaded
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F33%252Faa331605640af40fb3c49d0b970b6227%252Fpa%252FPZ73460_c8a54106e95cd2871ad67cd7ea19b842.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_c8a54106e95cd2871ad67cd7ea19b842.jpg already downloaded
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F33%252Faa331605640af40fb3c49d0b970b6227%252Fpa%252FPZ73460_2f470d2eeb90c23f3425a62b49db8114.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_2f470d2eeb90c23f3425a62b49db8114.jpg already downloaded
2026-03-28 21:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c0f5ceda-e1cf-54bd-a1fb-e8f939247828, identifier: PZ73460
2026-03-28 21:05:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61d9a728-a708-5231-b6aa-1a2e31c1ee92 with identifier: EK01014
2026-03-28 21:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61d9a728-a708-5231-b6aa-1a2e31c1ee92 with scrape type 1
2026-03-28 21:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 61d9a728-a708-5231-b6aa-1a2e31c1ee92
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fdc%252F5edcbbf966094b7f193940411d6af47a%252Fpa%252FEK01014_01a252ad4aa5836c45670e126d0a30fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_01a252ad4aa5836c45670e126d0a30fe.jpg already downloaded
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fdc%252F5edcbbf966094b7f193940411d6af47a%252Fpa%252FEK01014_f07c090824965ff11a226b570d9767b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_f07c090824965ff11a226b570d9767b8.jpg already downloaded
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fdc%252F5edcbbf966094b7f193940411d6af47a%252Fpa%252FEK01014_47dd9d944aec5a9be857b88f7cf5c1ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_47dd9d944aec5a9be857b88f7cf5c1ef.jpg already downloaded
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fdc%252F5edcbbf966094b7f193940411d6af47a%252Fpa%252FEK01014_f39955723196688867f14ff2d38ad387.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_f39955723196688867f14ff2d38ad387.jpg already downloaded
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fdc%252F5edcbbf966094b7f193940411d6af47a%252Fpa%252FEK01014_23414bc8cda0c1e6f7537920f95ce00b.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_23414bc8cda0c1e6f7537920f95ce00b.jpg already downloaded
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fdc%252F5edcbbf966094b7f193940411d6af47a%252Fpa%252FEK01014_2a66c7f7e975e990ed2d28dc26067b90.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_2a66c7f7e975e990ed2d28dc26067b90.jpg already downloaded
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fdc%252F5edcbbf966094b7f193940411d6af47a%252Fpa%252FEK01014_c069c7b77c83a3e9023e02641417d0c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_c069c7b77c83a3e9023e02641417d0c9.jpg already downloaded
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fdc%252F5edcbbf966094b7f193940411d6af47a%252Fpa%252FEK01014_35cb506c4676ed1d41e9c96c3645e166.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_35cb506c4676ed1d41e9c96c3645e166.jpg already downloaded
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fdc%252F5edcbbf966094b7f193940411d6af47a%252Fpa%252FEK01014_4aefc27d4b9170a19a4cc04a98c80482.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_4aefc27d4b9170a19a4cc04a98c80482.jpg already downloaded
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fdc%252F5edcbbf966094b7f193940411d6af47a%252Fpa%252FEK01014_972c959d039fbbc40278a5b34a2e7fbd.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_972c959d039fbbc40278a5b34a2e7fbd.jpg already downloaded
2026-03-28 21:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 61d9a728-a708-5231-b6aa-1a2e31c1ee92, identifier: EK01014
2026-03-28 21:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b841d5cd0>
2026-03-28 21:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49522c97-b589-5432-a887-7a3da0f74304/49522c97-b589-5432-a887-7a3da0f74304_image_4.jpg HTTP/1.1" 201 0
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F32%252F22322d846458aad14d7e5ec4e6cb8c7a%252Fpa%252FRX80413_82844c70e1e08e16e695e567e871df08.jpg') HTTP/1.1" 204 0
2026-03-28 21:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_82844c70e1e08e16e695e567e871df08.jpg saved to cache
2026-03-28 21:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 49522c97-b589-5432-a887-7a3da0f74304
2026-03-28 21:05:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c0f5ceda-e1cf-54bd-a1fb-e8f939247828 with identifier: PZ73460
2026-03-28 21:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c0f5ceda-e1cf-54bd-a1fb-e8f939247828 with identifier: PZ73460
2026-03-28 21:05:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c0f5ceda-e1cf-54bd-a1fb-e8f939247828 with identifier: PZ73460 to the API
2026-03-28 21:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PZ73460>
{'auction_title': '',
'c_o_2_emission_value': 162,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6B',
'engine': '3.0L',
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:58:58Z',
'fuel_type': 'diesel',
'id': 'c0f5ceda-e1cf-54bd-a1fb-e8f939247828',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ73460',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'Porsche',
'model': 'Macan',
'odometer': 273217,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_24e787638cc2242e96e7a41b5c5364e5.jpg',
'https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_f0d355834785ee9d7d2ce936ae24cc64.jpg',
'https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_a807c5e0d5b0ae3a36fb95434ac8160f.jpg',
'https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_0bf7034205fbeaa1f9d94884d9a29ab6.jpg',
'https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_6f8a066c770aea4534ed51e8e633888e.jpg',
'https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_2552e2b2ee39ec6043400164622a583a.jpg',
'https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_d4c522708f78fd9d3aa64dcf39c5ceac.jpg',
'https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_d8ef336dd231ea25762915a24dd474f4.jpg',
'https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_c8a54106e95cd2871ad67cd7ea19b842.jpg',
'https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_2f470d2eeb90c23f3425a62b49db8114.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f5ceda-e1cf-54bd-a1fb-e8f939247828/c0f5ceda-e1cf-54bd-a1fb-e8f939247828_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113332,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_24e787638cc2242e96e7a41b5c5364e5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f5ceda-e1cf-54bd-a1fb-e8f939247828/c0f5ceda-e1cf-54bd-a1fb-e8f939247828_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3361821,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_f0d355834785ee9d7d2ce936ae24cc64.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f5ceda-e1cf-54bd-a1fb-e8f939247828/c0f5ceda-e1cf-54bd-a1fb-e8f939247828_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3758133,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_a807c5e0d5b0ae3a36fb95434ac8160f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f5ceda-e1cf-54bd-a1fb-e8f939247828/c0f5ceda-e1cf-54bd-a1fb-e8f939247828_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95935,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_0bf7034205fbeaa1f9d94884d9a29ab6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f5ceda-e1cf-54bd-a1fb-e8f939247828/c0f5ceda-e1cf-54bd-a1fb-e8f939247828_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117850,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_6f8a066c770aea4534ed51e8e633888e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f5ceda-e1cf-54bd-a1fb-e8f939247828/c0f5ceda-e1cf-54bd-a1fb-e8f939247828_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3883157,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_2552e2b2ee39ec6043400164622a583a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f5ceda-e1cf-54bd-a1fb-e8f939247828/c0f5ceda-e1cf-54bd-a1fb-e8f939247828_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99522,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_d4c522708f78fd9d3aa64dcf39c5ceac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f5ceda-e1cf-54bd-a1fb-e8f939247828/c0f5ceda-e1cf-54bd-a1fb-e8f939247828_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3560791,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_d8ef336dd231ea25762915a24dd474f4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f5ceda-e1cf-54bd-a1fb-e8f939247828/c0f5ceda-e1cf-54bd-a1fb-e8f939247828_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3641629,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_c8a54106e95cd2871ad67cd7ea19b842.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f5ceda-e1cf-54bd-a1fb-e8f939247828/c0f5ceda-e1cf-54bd-a1fb-e8f939247828_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3495944,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/33/aa331605640af40fb3c49d0b970b6227/pa/PZ73460_2f470d2eeb90c23f3425a62b49db8114.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-01-24',
'seats_number': 5,
'seller_name': None,
'title': 'Porsche Macan S Diesel',
'transmission': 'automatic',
'trim': '',
'year': 2017}
2026-03-28 21:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ73460%27 HTTP/1.1" 200 None
2026-03-28 21:05:35 [auto1.it] INFO: Saving data for PZ73460: {'created_time': 1774731935.244419, 'last_price_update_time': 1774731935.244428, 'auction_closing_time': 1774886338.0}
2026-03-28 21:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PZ73460') HTTP/1.1" 204 0
2026-03-28 21:05:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 61d9a728-a708-5231-b6aa-1a2e31c1ee92 with identifier: EK01014
2026-03-28 21:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 61d9a728-a708-5231-b6aa-1a2e31c1ee92 with identifier: EK01014
2026-03-28 21:05:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 61d9a728-a708-5231-b6aa-1a2e31c1ee92 with identifier: EK01014 to the API
2026-03-28 21:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EK01014>
{'auction_title': '',
'c_o_2_emission_value': 150,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:27:23Z',
'fuel_type': 'diesel',
'id': '61d9a728-a708-5231-b6aa-1a2e31c1ee92',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK01014',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 151501,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_01a252ad4aa5836c45670e126d0a30fe.jpg',
'https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_f07c090824965ff11a226b570d9767b8.jpg',
'https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_47dd9d944aec5a9be857b88f7cf5c1ef.jpg',
'https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_f39955723196688867f14ff2d38ad387.jpg',
'https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_23414bc8cda0c1e6f7537920f95ce00b.jpg',
'https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_2a66c7f7e975e990ed2d28dc26067b90.jpg',
'https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_c069c7b77c83a3e9023e02641417d0c9.jpg',
'https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_35cb506c4676ed1d41e9c96c3645e166.jpg',
'https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_4aefc27d4b9170a19a4cc04a98c80482.jpg',
'https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_972c959d039fbbc40278a5b34a2e7fbd.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61d9a728-a708-5231-b6aa-1a2e31c1ee92/61d9a728-a708-5231-b6aa-1a2e31c1ee92_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74418,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_01a252ad4aa5836c45670e126d0a30fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61d9a728-a708-5231-b6aa-1a2e31c1ee92/61d9a728-a708-5231-b6aa-1a2e31c1ee92_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70500,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_f07c090824965ff11a226b570d9767b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61d9a728-a708-5231-b6aa-1a2e31c1ee92/61d9a728-a708-5231-b6aa-1a2e31c1ee92_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66901,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_47dd9d944aec5a9be857b88f7cf5c1ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61d9a728-a708-5231-b6aa-1a2e31c1ee92/61d9a728-a708-5231-b6aa-1a2e31c1ee92_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55666,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_f39955723196688867f14ff2d38ad387.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61d9a728-a708-5231-b6aa-1a2e31c1ee92/61d9a728-a708-5231-b6aa-1a2e31c1ee92_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67472,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_23414bc8cda0c1e6f7537920f95ce00b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61d9a728-a708-5231-b6aa-1a2e31c1ee92/61d9a728-a708-5231-b6aa-1a2e31c1ee92_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70990,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_2a66c7f7e975e990ed2d28dc26067b90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61d9a728-a708-5231-b6aa-1a2e31c1ee92/61d9a728-a708-5231-b6aa-1a2e31c1ee92_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54266,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_c069c7b77c83a3e9023e02641417d0c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61d9a728-a708-5231-b6aa-1a2e31c1ee92/61d9a728-a708-5231-b6aa-1a2e31c1ee92_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73518,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_35cb506c4676ed1d41e9c96c3645e166.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61d9a728-a708-5231-b6aa-1a2e31c1ee92/61d9a728-a708-5231-b6aa-1a2e31c1ee92_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80324,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_4aefc27d4b9170a19a4cc04a98c80482.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61d9a728-a708-5231-b6aa-1a2e31c1ee92/61d9a728-a708-5231-b6aa-1a2e31c1ee92_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54718,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/dc/5edcbbf966094b7f193940411d6af47a/pa/EK01014_972c959d039fbbc40278a5b34a2e7fbd.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-02-27',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Renegade 2.0 M-Jet Limited 4WD',
'transmission': 'automatic',
'trim': 'Limited 4WD',
'year': 2018}
2026-03-28 21:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK01014%27 HTTP/1.1" 200 None
2026-03-28 21:05:35 [auto1.it] INFO: Saving data for EK01014: {'created_time': 1774731935.590858, 'last_price_update_time': 1774731935.590871, 'auction_closing_time': 1774884443.0}
2026-03-28 21:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EK01014') HTTP/1.1" 204 0
2026-03-28 21:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b847ddf90>
2026-03-28 21:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49522c97-b589-5432-a887-7a3da0f74304/49522c97-b589-5432-a887-7a3da0f74304_image_1.jpg HTTP/1.1" 201 0
2026-03-28 21:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F32%252F22322d846458aad14d7e5ec4e6cb8c7a%252Fpa%252FRX80413_7c67b0f547d995b252762ca3ed2056d5.jpg') HTTP/1.1" 204 0
2026-03-28 21:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_7c67b0f547d995b252762ca3ed2056d5.jpg saved to cache
2026-03-28 21:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 49522c97-b589-5432-a887-7a3da0f74304
2026-03-28 21:05:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49522c97-b589-5432-a887-7a3da0f74304, skipping ID generation
2026-03-28 21:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49522c97-b589-5432-a887-7a3da0f74304 with scrape type 1
2026-03-28 21:05:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49522c97-b589-5432-a887-7a3da0f74304 sending to next pipeline
2026-03-28 21:05:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 49522c97-b589-5432-a887-7a3da0f74304, identifier: RX80413
2026-03-28 21:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PU50365> (referer: https://www.auto1.com/v1/car-details-view/PU50365/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 49522c97-b589-5432-a887-7a3da0f74304 with identifier: RX80413
2026-03-28 21:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 49522c97-b589-5432-a887-7a3da0f74304 with identifier: RX80413
2026-03-28 21:05:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 49522c97-b589-5432-a887-7a3da0f74304 with identifier: RX80413 to the API
2026-03-28 21:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_7c67b0f547d995b252762ca3ed2056d5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 160,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:10:35Z',
'fuel_type': 'diesel',
'id': '49522c97-b589-5432-a887-7a3da0f74304',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX80413',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Jeep',
'model': 'Cherokee',
'odometer': 134456,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49522c97-b589-5432-a887-7a3da0f74304/49522c97-b589-5432-a887-7a3da0f74304_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91704,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_c3572f96075c803928a717ebe02d7ec6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49522c97-b589-5432-a887-7a3da0f74304/49522c97-b589-5432-a887-7a3da0f74304_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92773,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_7c67b0f547d995b252762ca3ed2056d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49522c97-b589-5432-a887-7a3da0f74304/49522c97-b589-5432-a887-7a3da0f74304_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90462,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_6abdcb874ae49e191e17173c04ea85ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49522c97-b589-5432-a887-7a3da0f74304/49522c97-b589-5432-a887-7a3da0f74304_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68347,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_870ebda11d7d6364ebdb083535e69d3b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49522c97-b589-5432-a887-7a3da0f74304/49522c97-b589-5432-a887-7a3da0f74304_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88139,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_82844c70e1e08e16e695e567e871df08.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49522c97-b589-5432-a887-7a3da0f74304/49522c97-b589-5432-a887-7a3da0f74304_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88924,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_aa5c403f119b7586aa82012662a63bce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49522c97-b589-5432-a887-7a3da0f74304/49522c97-b589-5432-a887-7a3da0f74304_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70728,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_960300bcc19242215fe2e754a78964db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49522c97-b589-5432-a887-7a3da0f74304/49522c97-b589-5432-a887-7a3da0f74304_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80359,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_eb9d9b0e7de3c62b40f96435269d9380.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49522c97-b589-5432-a887-7a3da0f74304/49522c97-b589-5432-a887-7a3da0f74304_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85091,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_c7d9b98e1ec6ee74d0f9edbc2fa1dcf9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49522c97-b589-5432-a887-7a3da0f74304/49522c97-b589-5432-a887-7a3da0f74304_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69279,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/32/22322d846458aad14d7e5ec4e6cb8c7a/pa/RX80413_97688bc3cc4b9ecea28ff618e983f022.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-11-26',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Cherokee 2.2 M-Jet Limited 4WD',
'transmission': 'automatic',
'trim': 'Limited 4WD',
'year': 2015}
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX80413%27 HTTP/1.1" 200 None
2026-03-28 21:05:36 [auto1.it] INFO: Saving data for RX80413: {'created_time': 1774731936.078104, 'last_price_update_time': 1774731936.078116, 'auction_closing_time': 1774883435.0}
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RX80413') HTTP/1.1" 204 0
2026-03-28 21:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BZ50824> (referer: https://www.auto1.com/v1/car-details-view/BZ50824/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3fb07a0-edde-5c01-a450-db3ac03ce89e with identifier: PU50365
2026-03-28 21:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3fb07a0-edde-5c01-a450-db3ac03ce89e with scrape type 1
2026-03-28 21:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e3fb07a0-edde-5c01-a450-db3ac03ce89e
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb3%252F71b35239be88a2305ae6684237a85475%252Fpa%252FPU50365_1570b13f87ea1dfe99381ad4dff12cb6.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_1570b13f87ea1dfe99381ad4dff12cb6.jpg already downloaded
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb3%252F71b35239be88a2305ae6684237a85475%252Fpa%252FPU50365_a9f06e5a72fc891de0ffbb16d8f9b002.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_a9f06e5a72fc891de0ffbb16d8f9b002.jpg already downloaded
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb3%252F71b35239be88a2305ae6684237a85475%252Fpa%252FPU50365_07f3cd797fb0a00b57bc952c3550e6d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_07f3cd797fb0a00b57bc952c3550e6d0.jpg already downloaded
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb3%252F71b35239be88a2305ae6684237a85475%252Fpa%252FPU50365_16ec0ddcb0700d9871e7d2abf1c22188.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_16ec0ddcb0700d9871e7d2abf1c22188.jpg already downloaded
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb3%252F71b35239be88a2305ae6684237a85475%252Fpa%252FPU50365_5a686a555ed0b45fafacf67b0d50404b.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_5a686a555ed0b45fafacf67b0d50404b.jpg already downloaded
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb3%252F71b35239be88a2305ae6684237a85475%252Fpa%252FPU50365_064108874f83510ba6ba3db6516bcfbf.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_064108874f83510ba6ba3db6516bcfbf.jpg already downloaded
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb3%252F71b35239be88a2305ae6684237a85475%252Fpa%252FPU50365_7de8a34a644d46c7195cb9c05207c6a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_7de8a34a644d46c7195cb9c05207c6a1.jpg already downloaded
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb3%252F71b35239be88a2305ae6684237a85475%252Fpa%252FPU50365_2ae54f2f37339c7a47224e47e966aa7e.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_2ae54f2f37339c7a47224e47e966aa7e.jpg already downloaded
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb3%252F71b35239be88a2305ae6684237a85475%252Fpa%252FPU50365_aa61e257a8aa96b6b80a903c633f3b48.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_aa61e257a8aa96b6b80a903c633f3b48.jpg already downloaded
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb3%252F71b35239be88a2305ae6684237a85475%252Fpa%252FPU50365_18fde8792903fde5a10d3e3fc95ad178.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_18fde8792903fde5a10d3e3fc95ad178.jpg already downloaded
2026-03-28 21:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e3fb07a0-edde-5c01-a450-db3ac03ce89e, identifier: PU50365
2026-03-28 21:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e3fb07a0-edde-5c01-a450-db3ac03ce89e with identifier: PU50365
2026-03-28 21:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e3fb07a0-edde-5c01-a450-db3ac03ce89e with identifier: PU50365
2026-03-28 21:05:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e3fb07a0-edde-5c01-a450-db3ac03ce89e with identifier: PU50365 to the API
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PU50365>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:41:29Z',
'fuel_type': 'diesel',
'id': 'e3fb07a0-edde-5c01-a450-db3ac03ce89e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU50365',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'make': 'Audi',
'model': 'A4',
'odometer': 205518,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_1570b13f87ea1dfe99381ad4dff12cb6.jpg',
'https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_a9f06e5a72fc891de0ffbb16d8f9b002.jpg',
'https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_07f3cd797fb0a00b57bc952c3550e6d0.jpg',
'https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_16ec0ddcb0700d9871e7d2abf1c22188.jpg',
'https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_5a686a555ed0b45fafacf67b0d50404b.jpg',
'https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_064108874f83510ba6ba3db6516bcfbf.jpg',
'https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_7de8a34a644d46c7195cb9c05207c6a1.jpg',
'https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_2ae54f2f37339c7a47224e47e966aa7e.jpg',
'https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_aa61e257a8aa96b6b80a903c633f3b48.jpg',
'https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_18fde8792903fde5a10d3e3fc95ad178.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82808,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_1570b13f87ea1dfe99381ad4dff12cb6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2739108,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_a9f06e5a72fc891de0ffbb16d8f9b002.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72302,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_07f3cd797fb0a00b57bc952c3550e6d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56545,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_16ec0ddcb0700d9871e7d2abf1c22188.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2798544,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_5a686a555ed0b45fafacf67b0d50404b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79915,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_064108874f83510ba6ba3db6516bcfbf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59632,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_7de8a34a644d46c7195cb9c05207c6a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80482,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_2ae54f2f37339c7a47224e47e966aa7e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2957815,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_aa61e257a8aa96b6b80a903c633f3b48.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73321,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_18fde8792903fde5a10d3e3fc95ad178.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-02-27',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 2.0 TDI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2017}
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU50365%27 HTTP/1.1" 200 None
2026-03-28 21:05:36 [auto1.it] INFO: Saving data for PU50365: {'created_time': 1774731936.733105, 'last_price_update_time': 1774731936.733115, 'auction_closing_time': 1774885289.0}
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PU50365') HTTP/1.1" 204 0
2026-03-28 21:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KK08991> (referer: https://www.auto1.com/v1/car-details-view/KK08991/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UK25874> (referer: https://www.auto1.com/v1/car-details-view/UK25874/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9cc92ee-7cc3-5a21-bab8-e5921edbe785 with identifier: BZ50824
2026-03-28 21:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9cc92ee-7cc3-5a21-bab8-e5921edbe785 with scrape type 1
2026-03-28 21:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a9cc92ee-7cc3-5a21-bab8-e5921edbe785
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ffe%252Ffbfeb18fc6be578d50f20d50487f8ec2%252Fpa%252FBZ50824_2875f7d8bcbf5cd56d39c56d78576bfd.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/fe/fbfeb18fc6be578d50f20d50487f8ec2/pa/BZ50824_2875f7d8bcbf5cd56d39c56d78576bfd.jpg already downloaded
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ffe%252Ffbfeb18fc6be578d50f20d50487f8ec2%252Fpa%252FBZ50824_8545cb3f39650cda8fbc006bc32c5926.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/fe/fbfeb18fc6be578d50f20d50487f8ec2/pa/BZ50824_8545cb3f39650cda8fbc006bc32c5926.jpg already downloaded
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ffe%252Ffbfeb18fc6be578d50f20d50487f8ec2%252Fpa%252FBZ50824_f21b67f1c83d4a5dd6761d1163d9db2c.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/fe/fbfeb18fc6be578d50f20d50487f8ec2/pa/BZ50824_f21b67f1c83d4a5dd6761d1163d9db2c.jpg already downloaded
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ffe%252Ffbfeb18fc6be578d50f20d50487f8ec2%252Fpa%252FBZ50824_3d5bd6c81f3533bb8311e53a155451cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/fe/fbfeb18fc6be578d50f20d50487f8ec2/pa/BZ50824_3d5bd6c81f3533bb8311e53a155451cb.jpg already downloaded
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Ffe%252Ffbfeb18fc6be578d50f20d50487f8ec2%252Fpa%252FBZ50824_405a6f58aabe5bf0ac78a64f44956b8e.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/fe/fbfeb18fc6be578d50f20d50487f8ec2/pa/BZ50824_405a6f58aabe5bf0ac78a64f44956b8e.jpg already downloaded
2026-03-28 21:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a9cc92ee-7cc3-5a21-bab8-e5921edbe785, identifier: BZ50824
2026-03-28 21:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a9cc92ee-7cc3-5a21-bab8-e5921edbe785 with identifier: BZ50824
2026-03-28 21:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a9cc92ee-7cc3-5a21-bab8-e5921edbe785 with identifier: BZ50824
2026-03-28 21:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a9cc92ee-7cc3-5a21-bab8-e5921edbe785 with identifier: BZ50824 to the API
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BZ50824>
{'auction_title': '',
'c_o_2_emission_value': 85,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.5L',
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:44:52Z',
'fuel_type': 'diesel',
'id': 'a9cc92ee-7cc3-5a21-bab8-e5921edbe785',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ50824',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Renault',
'model': 'Clio',
'odometer': 239090,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/imgfb/fe/fbfeb18fc6be578d50f20d50487f8ec2/pa/BZ50824_2875f7d8bcbf5cd56d39c56d78576bfd.jpg',
'https://img-pa.auto1.com/imgfb/fe/fbfeb18fc6be578d50f20d50487f8ec2/pa/BZ50824_8545cb3f39650cda8fbc006bc32c5926.jpg',
'https://img-pa.auto1.com/imgfb/fe/fbfeb18fc6be578d50f20d50487f8ec2/pa/BZ50824_f21b67f1c83d4a5dd6761d1163d9db2c.jpg',
'https://img-pa.auto1.com/imgfb/fe/fbfeb18fc6be578d50f20d50487f8ec2/pa/BZ50824_3d5bd6c81f3533bb8311e53a155451cb.jpg',
'https://img-pa.auto1.com/imgfb/fe/fbfeb18fc6be578d50f20d50487f8ec2/pa/BZ50824_405a6f58aabe5bf0ac78a64f44956b8e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cc92ee-7cc3-5a21-bab8-e5921edbe785/a9cc92ee-7cc3-5a21-bab8-e5921edbe785_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71509,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/fe/fbfeb18fc6be578d50f20d50487f8ec2/pa/BZ50824_2875f7d8bcbf5cd56d39c56d78576bfd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cc92ee-7cc3-5a21-bab8-e5921edbe785/a9cc92ee-7cc3-5a21-bab8-e5921edbe785_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71425,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/fe/fbfeb18fc6be578d50f20d50487f8ec2/pa/BZ50824_8545cb3f39650cda8fbc006bc32c5926.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cc92ee-7cc3-5a21-bab8-e5921edbe785/a9cc92ee-7cc3-5a21-bab8-e5921edbe785_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72478,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/fe/fbfeb18fc6be578d50f20d50487f8ec2/pa/BZ50824_f21b67f1c83d4a5dd6761d1163d9db2c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cc92ee-7cc3-5a21-bab8-e5921edbe785/a9cc92ee-7cc3-5a21-bab8-e5921edbe785_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64167,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/fe/fbfeb18fc6be578d50f20d50487f8ec2/pa/BZ50824_3d5bd6c81f3533bb8311e53a155451cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9cc92ee-7cc3-5a21-bab8-e5921edbe785/a9cc92ee-7cc3-5a21-bab8-e5921edbe785_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50131,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/fe/fbfeb18fc6be578d50f20d50487f8ec2/pa/BZ50824_405a6f58aabe5bf0ac78a64f44956b8e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-09-30',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Energy Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2015}
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ50824%27 HTTP/1.1" 200 None
2026-03-28 21:05:37 [auto1.it] INFO: Saving data for BZ50824: {'created_time': 1774731937.308108, 'last_price_update_time': 1774731937.308121, 'auction_closing_time': 1774885492.0}
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BZ50824') HTTP/1.1" 204 0
2026-03-28 21:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b83bc44c-dbea-57cf-a201-3fbc1dec5b17 with identifier: KK08991
2026-03-28 21:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b83bc44c-dbea-57cf-a201-3fbc1dec5b17 with scrape type 1
2026-03-28 21:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b83bc44c-dbea-57cf-a201-3fbc1dec5b17
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F3e%252Fbc3ee447940cfaf4b6d7d4647fded8d6%252Fpa%252FKK08991_37b0c17547258dfc402f80cfe246a6b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_37b0c17547258dfc402f80cfe246a6b8.jpg already downloaded
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F3e%252Fbc3ee447940cfaf4b6d7d4647fded8d6%252Fpa%252FKK08991_e93f2bba24d66c1e9deaa2828d4a9ecc.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_e93f2bba24d66c1e9deaa2828d4a9ecc.jpg already downloaded
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F3e%252Fbc3ee447940cfaf4b6d7d4647fded8d6%252Fpa%252FKK08991_3c3d016fc6a8b1d3737a144ea714ec94.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_3c3d016fc6a8b1d3737a144ea714ec94.jpg already downloaded
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F3e%252Fbc3ee447940cfaf4b6d7d4647fded8d6%252Fpa%252FKK08991_ddfbc5375458a5ad5c9e3d3c4fe11927.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_ddfbc5375458a5ad5c9e3d3c4fe11927.jpg already downloaded
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F3e%252Fbc3ee447940cfaf4b6d7d4647fded8d6%252Fpa%252FKK08991_cce5d2dda1a3bc83bb228c57f6c232fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_cce5d2dda1a3bc83bb228c57f6c232fb.jpg already downloaded
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F3e%252Fbc3ee447940cfaf4b6d7d4647fded8d6%252Fpa%252FKK08991_e46a82fbc5f5dbc47ea23e4066d365eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_e46a82fbc5f5dbc47ea23e4066d365eb.jpg already downloaded
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F3e%252Fbc3ee447940cfaf4b6d7d4647fded8d6%252Fpa%252FKK08991_8293c63f193f32910026827da8bebc38.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_8293c63f193f32910026827da8bebc38.jpg already downloaded
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F3e%252Fbc3ee447940cfaf4b6d7d4647fded8d6%252Fpa%252FKK08991_de079826428ead8208329002321370f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_de079826428ead8208329002321370f8.jpg already downloaded
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F3e%252Fbc3ee447940cfaf4b6d7d4647fded8d6%252Fpa%252FKK08991_322b9094e154463a045609f6e8c5f6e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_322b9094e154463a045609f6e8c5f6e3.jpg already downloaded
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252F3e%252Fbc3ee447940cfaf4b6d7d4647fded8d6%252Fpa%252FKK08991_5bdedfec6b3f45acaf2be93c1f32b98b.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_5bdedfec6b3f45acaf2be93c1f32b98b.jpg already downloaded
2026-03-28 21:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b83bc44c-dbea-57cf-a201-3fbc1dec5b17, identifier: KK08991
2026-03-28 21:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa3be3a1-0bc7-5892-abae-43eae8eb1dcb with identifier: UK25874
2026-03-28 21:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa3be3a1-0bc7-5892-abae-43eae8eb1dcb with scrape type 1
2026-03-28 21:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item fa3be3a1-0bc7-5892-abae-43eae8eb1dcb
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F52%252Fac5246f1e576e0564c2123c77aa70c16%252Fpa%252FUK25874_3d1ff7daf54bea3e22c13d61301f2ae0.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/52/ac5246f1e576e0564c2123c77aa70c16/pa/UK25874_3d1ff7daf54bea3e22c13d61301f2ae0.jpg already downloaded
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F52%252Fac5246f1e576e0564c2123c77aa70c16%252Fpa%252FUK25874_8ffa653bc9aa01f69993b6819b2676da.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/52/ac5246f1e576e0564c2123c77aa70c16/pa/UK25874_8ffa653bc9aa01f69993b6819b2676da.jpg already downloaded
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F52%252Fac5246f1e576e0564c2123c77aa70c16%252Fpa%252FUK25874_cbfa91f30bbae9b2cddc528d71b9bf7d.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/52/ac5246f1e576e0564c2123c77aa70c16/pa/UK25874_cbfa91f30bbae9b2cddc528d71b9bf7d.jpg already downloaded
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F52%252Fac5246f1e576e0564c2123c77aa70c16%252Fpa%252FUK25874_ad1bcfe80cfcd1e3fee587c7607d7f18.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/52/ac5246f1e576e0564c2123c77aa70c16/pa/UK25874_ad1bcfe80cfcd1e3fee587c7607d7f18.jpg already downloaded
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F52%252Fac5246f1e576e0564c2123c77aa70c16%252Fpa%252FUK25874_6801b4e907164b2b5dc4c632608380fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/52/ac5246f1e576e0564c2123c77aa70c16/pa/UK25874_6801b4e907164b2b5dc4c632608380fa.jpg already downloaded
2026-03-28 21:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fa3be3a1-0bc7-5892-abae-43eae8eb1dcb, identifier: UK25874
2026-03-28 21:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b83bc44c-dbea-57cf-a201-3fbc1dec5b17 with identifier: KK08991
2026-03-28 21:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b83bc44c-dbea-57cf-a201-3fbc1dec5b17 with identifier: KK08991
2026-03-28 21:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b83bc44c-dbea-57cf-a201-3fbc1dec5b17 with identifier: KK08991 to the API
2026-03-28 21:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KK08991>
{'auction_title': '',
'c_o_2_emission_value': 46,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.3L',
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:24:13Z',
'fuel_type': 'hybrid',
'id': 'b83bc44c-dbea-57cf-a201-3fbc1dec5b17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK08991',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 64274,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_37b0c17547258dfc402f80cfe246a6b8.jpg',
'https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_e93f2bba24d66c1e9deaa2828d4a9ecc.jpg',
'https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_3c3d016fc6a8b1d3737a144ea714ec94.jpg',
'https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_ddfbc5375458a5ad5c9e3d3c4fe11927.jpg',
'https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_cce5d2dda1a3bc83bb228c57f6c232fb.jpg',
'https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_e46a82fbc5f5dbc47ea23e4066d365eb.jpg',
'https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_8293c63f193f32910026827da8bebc38.jpg',
'https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_de079826428ead8208329002321370f8.jpg',
'https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_322b9094e154463a045609f6e8c5f6e3.jpg',
'https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_5bdedfec6b3f45acaf2be93c1f32b98b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b83bc44c-dbea-57cf-a201-3fbc1dec5b17/b83bc44c-dbea-57cf-a201-3fbc1dec5b17_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2546301,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_37b0c17547258dfc402f80cfe246a6b8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b83bc44c-dbea-57cf-a201-3fbc1dec5b17/b83bc44c-dbea-57cf-a201-3fbc1dec5b17_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70927,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_e93f2bba24d66c1e9deaa2828d4a9ecc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b83bc44c-dbea-57cf-a201-3fbc1dec5b17/b83bc44c-dbea-57cf-a201-3fbc1dec5b17_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67284,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_3c3d016fc6a8b1d3737a144ea714ec94.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b83bc44c-dbea-57cf-a201-3fbc1dec5b17/b83bc44c-dbea-57cf-a201-3fbc1dec5b17_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57836,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_ddfbc5375458a5ad5c9e3d3c4fe11927.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b83bc44c-dbea-57cf-a201-3fbc1dec5b17/b83bc44c-dbea-57cf-a201-3fbc1dec5b17_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58013,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_cce5d2dda1a3bc83bb228c57f6c232fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b83bc44c-dbea-57cf-a201-3fbc1dec5b17/b83bc44c-dbea-57cf-a201-3fbc1dec5b17_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2592318,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_e46a82fbc5f5dbc47ea23e4066d365eb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b83bc44c-dbea-57cf-a201-3fbc1dec5b17/b83bc44c-dbea-57cf-a201-3fbc1dec5b17_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55182,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_8293c63f193f32910026827da8bebc38.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b83bc44c-dbea-57cf-a201-3fbc1dec5b17/b83bc44c-dbea-57cf-a201-3fbc1dec5b17_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68060,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_de079826428ead8208329002321370f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b83bc44c-dbea-57cf-a201-3fbc1dec5b17/b83bc44c-dbea-57cf-a201-3fbc1dec5b17_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72425,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_322b9094e154463a045609f6e8c5f6e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b83bc44c-dbea-57cf-a201-3fbc1dec5b17/b83bc44c-dbea-57cf-a201-3fbc1dec5b17_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44452,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbc/3e/bc3ee447940cfaf4b6d7d4647fded8d6/pa/KK08991_5bdedfec6b3f45acaf2be93c1f32b98b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-09-14',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Renegade 1.3 T4 4xe Plug-in Hybrid 80th Anniversary',
'transmission': 'automatic',
'trim': '80th Anniversary',
'year': 2021}
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK08991%27 HTTP/1.1" 200 None
2026-03-28 21:05:38 [auto1.it] INFO: Saving data for KK08991: {'created_time': 1774731938.185201, 'last_price_update_time': 1774731938.185212, 'auction_closing_time': 1774884253.0}
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KK08991') HTTP/1.1" 204 0
2026-03-28 21:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fa3be3a1-0bc7-5892-abae-43eae8eb1dcb with identifier: UK25874
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-28 21:05:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 21:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fa3be3a1-0bc7-5892-abae-43eae8eb1dcb with identifier: UK25874
2026-03-28 21:05:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fa3be3a1-0bc7-5892-abae-43eae8eb1dcb with identifier: UK25874 to the API
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UK25874>
{'auction_title': '',
'c_o_2_emission_value': 174,
'category': None,
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.9L',
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:04:27Z',
'fuel_type': 'diesel',
'id': 'fa3be3a1-0bc7-5892-abae-43eae8eb1dcb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK25874',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Fiat',
'model': 'Sedici',
'odometer': 184057,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/imgac/52/ac5246f1e576e0564c2123c77aa70c16/pa/UK25874_3d1ff7daf54bea3e22c13d61301f2ae0.jpg',
'https://img-pa.auto1.com/imgac/52/ac5246f1e576e0564c2123c77aa70c16/pa/UK25874_8ffa653bc9aa01f69993b6819b2676da.jpg',
'https://img-pa.auto1.com/imgac/52/ac5246f1e576e0564c2123c77aa70c16/pa/UK25874_cbfa91f30bbae9b2cddc528d71b9bf7d.jpg',
'https://img-pa.auto1.com/imgac/52/ac5246f1e576e0564c2123c77aa70c16/pa/UK25874_ad1bcfe80cfcd1e3fee587c7607d7f18.jpg',
'https://img-pa.auto1.com/imgac/52/ac5246f1e576e0564c2123c77aa70c16/pa/UK25874_6801b4e907164b2b5dc4c632608380fa.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3be3a1-0bc7-5892-abae-43eae8eb1dcb/fa3be3a1-0bc7-5892-abae-43eae8eb1dcb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100763,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/52/ac5246f1e576e0564c2123c77aa70c16/pa/UK25874_3d1ff7daf54bea3e22c13d61301f2ae0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3be3a1-0bc7-5892-abae-43eae8eb1dcb/fa3be3a1-0bc7-5892-abae-43eae8eb1dcb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95083,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/52/ac5246f1e576e0564c2123c77aa70c16/pa/UK25874_8ffa653bc9aa01f69993b6819b2676da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3be3a1-0bc7-5892-abae-43eae8eb1dcb/fa3be3a1-0bc7-5892-abae-43eae8eb1dcb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85543,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/52/ac5246f1e576e0564c2123c77aa70c16/pa/UK25874_cbfa91f30bbae9b2cddc528d71b9bf7d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3be3a1-0bc7-5892-abae-43eae8eb1dcb/fa3be3a1-0bc7-5892-abae-43eae8eb1dcb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66647,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/52/ac5246f1e576e0564c2123c77aa70c16/pa/UK25874_ad1bcfe80cfcd1e3fee587c7607d7f18.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa3be3a1-0bc7-5892-abae-43eae8eb1dcb/fa3be3a1-0bc7-5892-abae-43eae8eb1dcb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61111,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/52/ac5246f1e576e0564c2123c77aa70c16/pa/UK25874_6801b4e907164b2b5dc4c632608380fa.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-10-31',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Sedici 1.9 JTD Multijet Emotion 4x4',
'transmission': 'manual',
'trim': 'Multijet Emotion 4x4',
'year': 2006}
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK25874%27 HTTP/1.1" 200 None
2026-03-28 21:05:38 [auto1.it] INFO: Saving data for UK25874: {'created_time': 1774731938.636345, 'last_price_update_time': 1774731938.63636, 'auction_closing_time': 1774883067.0}
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UK25874') HTTP/1.1" 204 0
2026-03-28 21:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EW80133> (referer: https://www.auto1.com/v1/car-details-view/EW80133/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VF83639> (referer: https://www.auto1.com/v1/car-details-view/VF83639/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bc89a26-2ebc-5031-b4ce-96e11efaee08 with identifier: EW80133
2026-03-28 21:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bc89a26-2ebc-5031-b4ce-96e11efaee08 with scrape type 1
2026-03-28 21:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2bc89a26-2ebc-5031-b4ce-96e11efaee08
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F62%252Fc962e44e42ae50c48b89f32ac81474f8%252Fpa%252FEW80133_51c01f3032aebb6e534421ee5d54a234.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_51c01f3032aebb6e534421ee5d54a234.jpg already downloaded
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F62%252Fc962e44e42ae50c48b89f32ac81474f8%252Fpa%252FEW80133_7e9fde3c312c6dbe313d47a17aef2577.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_7e9fde3c312c6dbe313d47a17aef2577.jpg already downloaded
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F62%252Fc962e44e42ae50c48b89f32ac81474f8%252Fpa%252FEW80133_2e953bf0a886d93b3ad33707c3d01953.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_2e953bf0a886d93b3ad33707c3d01953.jpg already downloaded
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F62%252Fc962e44e42ae50c48b89f32ac81474f8%252Fpa%252FEW80133_303adcddfd6eade36e93e13535a09b47.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_303adcddfd6eade36e93e13535a09b47.jpg already downloaded
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F62%252Fc962e44e42ae50c48b89f32ac81474f8%252Fpa%252FEW80133_f891b9d9a3875e77580cdbd65415c3a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_f891b9d9a3875e77580cdbd65415c3a4.jpg already downloaded
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F62%252Fc962e44e42ae50c48b89f32ac81474f8%252Fpa%252FEW80133_b3e1122c8b4eabecfe73d49b231d5b55.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_b3e1122c8b4eabecfe73d49b231d5b55.jpg already downloaded
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F62%252Fc962e44e42ae50c48b89f32ac81474f8%252Fpa%252FEW80133_efcfc416237695a01cec8e4907e6cb19.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_efcfc416237695a01cec8e4907e6cb19.jpg already downloaded
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F62%252Fc962e44e42ae50c48b89f32ac81474f8%252Fpa%252FEW80133_6a39eb535942796e63c1fc2ffb05b3f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_6a39eb535942796e63c1fc2ffb05b3f3.jpg already downloaded
2026-03-28 21:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F62%252Fc962e44e42ae50c48b89f32ac81474f8%252Fpa%252FEW80133_60f1b6b9dc29679c61f6bc13d886ead4.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_60f1b6b9dc29679c61f6bc13d886ead4.jpg already downloaded
2026-03-28 21:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F62%252Fc962e44e42ae50c48b89f32ac81474f8%252Fpa%252FEW80133_8cb70a740e86677d07e717b98046862e.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_8cb70a740e86677d07e717b98046862e.jpg already downloaded
2026-03-28 21:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2bc89a26-2ebc-5031-b4ce-96e11efaee08, identifier: EW80133
2026-03-28 21:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0299264-1740-53b7-a5cf-dd31355ad651 with identifier: VF83639
2026-03-28 21:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0299264-1740-53b7-a5cf-dd31355ad651 with scrape type 1
2026-03-28 21:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item b0299264-1740-53b7-a5cf-dd31355ad651
2026-03-28 21:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F62%252F0362b73ad8df927aafda7d8ab1c571f0%252Fpa%252FVF83639_ecb42bdcbdd87b7345e02370a859a92d.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/62/0362b73ad8df927aafda7d8ab1c571f0/pa/VF83639_ecb42bdcbdd87b7345e02370a859a92d.jpg already downloaded
2026-03-28 21:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F62%252F0362b73ad8df927aafda7d8ab1c571f0%252Fpa%252FVF83639_3d4d18626f7070f92b2b4d747ce6c01f.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/62/0362b73ad8df927aafda7d8ab1c571f0/pa/VF83639_3d4d18626f7070f92b2b4d747ce6c01f.jpg already downloaded
2026-03-28 21:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F62%252F0362b73ad8df927aafda7d8ab1c571f0%252Fpa%252FVF83639_0130e078fe2dd64924e42f9b0e146515.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/62/0362b73ad8df927aafda7d8ab1c571f0/pa/VF83639_0130e078fe2dd64924e42f9b0e146515.jpg already downloaded
2026-03-28 21:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F62%252F0362b73ad8df927aafda7d8ab1c571f0%252Fpa%252FVF83639_e7615784ff295d45220f4d438d0f63b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/62/0362b73ad8df927aafda7d8ab1c571f0/pa/VF83639_e7615784ff295d45220f4d438d0f63b4.jpg already downloaded
2026-03-28 21:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F62%252F0362b73ad8df927aafda7d8ab1c571f0%252Fpa%252FVF83639_d446c3699c2e45e324769effcd2fbaab.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/62/0362b73ad8df927aafda7d8ab1c571f0/pa/VF83639_d446c3699c2e45e324769effcd2fbaab.jpg already downloaded
2026-03-28 21:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b0299264-1740-53b7-a5cf-dd31355ad651, identifier: VF83639
2026-03-28 21:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2bc89a26-2ebc-5031-b4ce-96e11efaee08 with identifier: EW80133
2026-03-28 21:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2bc89a26-2ebc-5031-b4ce-96e11efaee08 with identifier: EW80133
2026-03-28 21:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2bc89a26-2ebc-5031-b4ce-96e11efaee08 with identifier: EW80133 to the API
2026-03-28 21:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EW80133>
{'auction_title': '',
'c_o_2_emission_value': 147,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:41:37Z',
'fuel_type': 'diesel',
'id': '2bc89a26-2ebc-5031-b4ce-96e11efaee08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW80133',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 267991,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_51c01f3032aebb6e534421ee5d54a234.jpg',
'https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_7e9fde3c312c6dbe313d47a17aef2577.jpg',
'https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_2e953bf0a886d93b3ad33707c3d01953.jpg',
'https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_303adcddfd6eade36e93e13535a09b47.jpg',
'https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_f891b9d9a3875e77580cdbd65415c3a4.jpg',
'https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_b3e1122c8b4eabecfe73d49b231d5b55.jpg',
'https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_efcfc416237695a01cec8e4907e6cb19.jpg',
'https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_6a39eb535942796e63c1fc2ffb05b3f3.jpg',
'https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_60f1b6b9dc29679c61f6bc13d886ead4.jpg',
'https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_8cb70a740e86677d07e717b98046862e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bc89a26-2ebc-5031-b4ce-96e11efaee08/2bc89a26-2ebc-5031-b4ce-96e11efaee08_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68269,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_51c01f3032aebb6e534421ee5d54a234.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bc89a26-2ebc-5031-b4ce-96e11efaee08/2bc89a26-2ebc-5031-b4ce-96e11efaee08_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66260,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_7e9fde3c312c6dbe313d47a17aef2577.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bc89a26-2ebc-5031-b4ce-96e11efaee08/2bc89a26-2ebc-5031-b4ce-96e11efaee08_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69198,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_2e953bf0a886d93b3ad33707c3d01953.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bc89a26-2ebc-5031-b4ce-96e11efaee08/2bc89a26-2ebc-5031-b4ce-96e11efaee08_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53396,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_303adcddfd6eade36e93e13535a09b47.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bc89a26-2ebc-5031-b4ce-96e11efaee08/2bc89a26-2ebc-5031-b4ce-96e11efaee08_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69528,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_f891b9d9a3875e77580cdbd65415c3a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bc89a26-2ebc-5031-b4ce-96e11efaee08/2bc89a26-2ebc-5031-b4ce-96e11efaee08_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2293401,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_b3e1122c8b4eabecfe73d49b231d5b55.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bc89a26-2ebc-5031-b4ce-96e11efaee08/2bc89a26-2ebc-5031-b4ce-96e11efaee08_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56018,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_efcfc416237695a01cec8e4907e6cb19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bc89a26-2ebc-5031-b4ce-96e11efaee08/2bc89a26-2ebc-5031-b4ce-96e11efaee08_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65584,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_6a39eb535942796e63c1fc2ffb05b3f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bc89a26-2ebc-5031-b4ce-96e11efaee08/2bc89a26-2ebc-5031-b4ce-96e11efaee08_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69737,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_60f1b6b9dc29679c61f6bc13d886ead4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bc89a26-2ebc-5031-b4ce-96e11efaee08/2bc89a26-2ebc-5031-b4ce-96e11efaee08_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70948,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/62/c962e44e42ae50c48b89f32ac81474f8/pa/EW80133_8cb70a740e86677d07e717b98046862e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-02-05',
'seats_number': 7,
'seller_name': None,
'title': 'Seat Alhambra 2.0 TDI Style Advanced 4Drive',
'transmission': 'manual',
'trim': 'Style Advanced 4Drive',
'year': 2018}
2026-03-28 21:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW80133%27 HTTP/1.1" 200 None
2026-03-28 21:05:39 [auto1.it] INFO: Saving data for EW80133: {'created_time': 1774731939.665096, 'last_price_update_time': 1774731939.665108, 'auction_closing_time': 1774885297.0}
2026-03-28 21:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EW80133') HTTP/1.1" 204 0
2026-03-28 21:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b0299264-1740-53b7-a5cf-dd31355ad651 with identifier: VF83639
2026-03-28 21:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b0299264-1740-53b7-a5cf-dd31355ad651 with identifier: VF83639
2026-03-28 21:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b0299264-1740-53b7-a5cf-dd31355ad651 with identifier: VF83639 to the API
2026-03-28 21:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VF83639>
{'auction_title': '',
'c_o_2_emission_value': 137,
'category': 'Rental',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.5L',
'engine_horse_power': 103,
'expiration_date': '2026-03-30T15:25:13Z',
'fuel_type': 'diesel',
'id': 'b0299264-1740-53b7-a5cf-dd31355ad651',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF83639',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Renault',
'model': 'Scenic',
'odometer': 286353,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/img03/62/0362b73ad8df927aafda7d8ab1c571f0/pa/VF83639_ecb42bdcbdd87b7345e02370a859a92d.jpg',
'https://img-pa.auto1.com/img03/62/0362b73ad8df927aafda7d8ab1c571f0/pa/VF83639_3d4d18626f7070f92b2b4d747ce6c01f.jpg',
'https://img-pa.auto1.com/img03/62/0362b73ad8df927aafda7d8ab1c571f0/pa/VF83639_0130e078fe2dd64924e42f9b0e146515.jpg',
'https://img-pa.auto1.com/img03/62/0362b73ad8df927aafda7d8ab1c571f0/pa/VF83639_e7615784ff295d45220f4d438d0f63b4.jpg',
'https://img-pa.auto1.com/img03/62/0362b73ad8df927aafda7d8ab1c571f0/pa/VF83639_d446c3699c2e45e324769effcd2fbaab.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0299264-1740-53b7-a5cf-dd31355ad651/b0299264-1740-53b7-a5cf-dd31355ad651_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79935,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/62/0362b73ad8df927aafda7d8ab1c571f0/pa/VF83639_ecb42bdcbdd87b7345e02370a859a92d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0299264-1740-53b7-a5cf-dd31355ad651/b0299264-1740-53b7-a5cf-dd31355ad651_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82326,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/62/0362b73ad8df927aafda7d8ab1c571f0/pa/VF83639_3d4d18626f7070f92b2b4d747ce6c01f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0299264-1740-53b7-a5cf-dd31355ad651/b0299264-1740-53b7-a5cf-dd31355ad651_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79642,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/62/0362b73ad8df927aafda7d8ab1c571f0/pa/VF83639_0130e078fe2dd64924e42f9b0e146515.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0299264-1740-53b7-a5cf-dd31355ad651/b0299264-1740-53b7-a5cf-dd31355ad651_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60172,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/62/0362b73ad8df927aafda7d8ab1c571f0/pa/VF83639_e7615784ff295d45220f4d438d0f63b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0299264-1740-53b7-a5cf-dd31355ad651/b0299264-1740-53b7-a5cf-dd31355ad651_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52584,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/62/0362b73ad8df927aafda7d8ab1c571f0/pa/VF83639_d446c3699c2e45e324769effcd2fbaab.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2008-06-17',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Scenic 1.5 dCi Expression',
'transmission': 'manual',
'trim': 'Expression',
'year': 2008}
2026-03-28 21:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF83639%27 HTTP/1.1" 200 None
2026-03-28 21:05:40 [auto1.it] INFO: Saving data for VF83639: {'created_time': 1774731940.12483, 'last_price_update_time': 1774731940.124843, 'auction_closing_time': 1774884313.0}
2026-03-28 21:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VF83639') HTTP/1.1" 204 0
2026-03-28 21:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:45 [auto1.it] INFO: Channel: 24h | Page: 5 | totalHits: 2224 | hits on page: 40
2026-03-28 21:05:45 [auto1.it] INFO: Found listing with ID: CX56381
2026-03-28 21:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CX56381%27 HTTP/1.1" 200 None
2026-03-28 21:05:45 [auto1.it] INFO: Scrape type for CX56381: 0
2026-03-28 21:05:45 [auto1.it] INFO: Found listing with ID: FB75949
2026-03-28 21:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB75949%27 HTTP/1.1" 200 None
2026-03-28 21:05:45 [auto1.it] INFO: Scrape type for FB75949: 2
2026-03-28 21:05:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c74e0914-3049-5aec-ae2e-1bcc30d1e782 with identifier: FB75949
2026-03-28 21:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c74e0914-3049-5aec-ae2e-1bcc30d1e782 with scrape type 2
2026-03-28 21:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c74e0914-3049-5aec-ae2e-1bcc30d1e782 with scrape type 2
2026-03-28 21:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c74e0914-3049-5aec-ae2e-1bcc30d1e782, identifier: FB75949
2026-03-28 21:05:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c74e0914-3049-5aec-ae2e-1bcc30d1e782 with identifier: FB75949
2026-03-28 21:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 21:05:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 21:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c74e0914-3049-5aec-ae2e-1bcc30d1e782 with identifier: FB75949
2026-03-28 21:05:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c74e0914-3049-5aec-ae2e-1bcc30d1e782 with identifier: FB75949 to the API
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-30T15:16:43Z',
'fuel_type': 'hybrid',
'id': 'c74e0914-3049-5aec-ae2e-1bcc30d1e782',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB75949',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 33513,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-24',
'seller_name': None,
'title': 'Peugeot 3008 1.6 Hybrid 225 GT',
'transmission': 'automatic',
'trim': '225 GT',
'year': 2022}
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB75949%27 HTTP/1.1" 200 None
2026-03-28 21:05:46 [auto1.it] INFO: Saving data for FB75949: {'auction_closing_time': 1774883803.0, 'created_time': 1774533952.103127, 'last_price_update_time': 1774731946.470984}
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FB75949') HTTP/1.1" 204 0
2026-03-28 21:05:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:46 [auto1.it] INFO: Found listing with ID: JA23612
2026-03-28 21:05:46 [auto1.it] INFO: Found listing with ID: EM60693
2026-03-28 21:05:46 [auto1.it] INFO: Found listing with ID: LC51604
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC51604%27 HTTP/1.1" 200 None
2026-03-28 21:05:46 [auto1.it] INFO: Scrape type for LC51604: 0
2026-03-28 21:05:46 [auto1.it] INFO: Found listing with ID: KM71175
2026-03-28 21:05:46 [auto1.it] INFO: Found listing with ID: UK70353
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK70353%27 HTTP/1.1" 200 None
2026-03-28 21:05:46 [auto1.it] INFO: Scrape type for UK70353: 0
2026-03-28 21:05:46 [auto1.it] INFO: Found listing with ID: AE34833
2026-03-28 21:05:46 [auto1.it] INFO: Found listing with ID: AU35917
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU35917%27 HTTP/1.1" 200 None
2026-03-28 21:05:46 [auto1.it] INFO: Scrape type for AU35917: 1
2026-03-28 21:05:46 [auto1.it] INFO: Found listing with ID: PB29949
2026-03-28 21:05:46 [auto1.it] INFO: Found listing with ID: DR37659
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR37659%27 HTTP/1.1" 200 None
2026-03-28 21:05:46 [auto1.it] INFO: Scrape type for DR37659: 0
2026-03-28 21:05:46 [auto1.it] INFO: Found listing with ID: WY72750
2026-03-28 21:05:46 [auto1.it] INFO: Found listing with ID: XH41983
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH41983%27 HTTP/1.1" 200 None
2026-03-28 21:05:46 [auto1.it] INFO: Scrape type for XH41983: 0
2026-03-28 21:05:46 [auto1.it] INFO: Found listing with ID: LC01017
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC01017%27 HTTP/1.1" 200 None
2026-03-28 21:05:46 [auto1.it] INFO: Scrape type for LC01017: 0
2026-03-28 21:05:46 [auto1.it] INFO: Found listing with ID: MW60739
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW60739%27 HTTP/1.1" 200 None
2026-03-28 21:05:46 [auto1.it] INFO: Scrape type for MW60739: 0
2026-03-28 21:05:46 [auto1.it] INFO: Found listing with ID: RR03246
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR03246%27 HTTP/1.1" 200 None
2026-03-28 21:05:46 [auto1.it] INFO: Scrape type for RR03246: 0
2026-03-28 21:05:46 [auto1.it] INFO: Found listing with ID: HY79670
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY79670%27 HTTP/1.1" 200 None
2026-03-28 21:05:46 [auto1.it] INFO: Scrape type for HY79670: 0
2026-03-28 21:05:46 [auto1.it] INFO: Found listing with ID: EC99785
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC99785%27 HTTP/1.1" 200 None
2026-03-28 21:05:46 [auto1.it] INFO: Scrape type for EC99785: 0
2026-03-28 21:05:46 [auto1.it] INFO: Found listing with ID: MB50671
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB50671%27 HTTP/1.1" 200 None
2026-03-28 21:05:46 [auto1.it] INFO: Scrape type for MB50671: 2
2026-03-28 21:05:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e75399f5-9dc2-55a0-b222-20c0b3ff4361 with identifier: MB50671
2026-03-28 21:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e75399f5-9dc2-55a0-b222-20c0b3ff4361 with scrape type 2
2026-03-28 21:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e75399f5-9dc2-55a0-b222-20c0b3ff4361 with scrape type 2
2026-03-28 21:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e75399f5-9dc2-55a0-b222-20c0b3ff4361, identifier: MB50671
2026-03-28 21:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e75399f5-9dc2-55a0-b222-20c0b3ff4361 with identifier: MB50671
2026-03-28 21:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e75399f5-9dc2-55a0-b222-20c0b3ff4361 with identifier: MB50671
2026-03-28 21:05:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e75399f5-9dc2-55a0-b222-20c0b3ff4361 with identifier: MB50671 to the API
2026-03-28 21:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:17:42Z',
'fuel_type': 'diesel',
'id': 'e75399f5-9dc2-55a0-b222-20c0b3ff4361',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB50671',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Rifter',
'odometer': 49694,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-25',
'seller_name': None,
'title': 'Peugeot Rifter 1.5 Blue-HDi Allure N1 L1',
'transmission': 'manual',
'trim': 'Allure N1 L1',
'year': 2022}
2026-03-28 21:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB50671%27 HTTP/1.1" 200 None
2026-03-28 21:05:47 [auto1.it] INFO: Saving data for MB50671: {'auction_closing_time': 1774883862.0, 'created_time': 1774534016.621724, 'last_price_update_time': 1774731947.417412}
2026-03-28 21:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MB50671') HTTP/1.1" 204 0
2026-03-28 21:05:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:47 [auto1.it] INFO: Found listing with ID: JF90456
2026-03-28 21:05:47 [auto1.it] INFO: Found listing with ID: WZ44056
2026-03-28 21:05:47 [auto1.it] INFO: Found listing with ID: LL94615
2026-03-28 21:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LL94615%27 HTTP/1.1" 200 None
2026-03-28 21:05:47 [auto1.it] INFO: Scrape type for LL94615: 0
2026-03-28 21:05:47 [auto1.it] INFO: Found listing with ID: DC03945
2026-03-28 21:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC03945%27 HTTP/1.1" 200 None
2026-03-28 21:05:47 [auto1.it] INFO: Scrape type for DC03945: 0
2026-03-28 21:05:47 [auto1.it] INFO: Found listing with ID: BH62739
2026-03-28 21:05:47 [auto1.it] INFO: Found listing with ID: LR71348
2026-03-28 21:05:47 [auto1.it] INFO: Found listing with ID: ML20734
2026-03-28 21:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML20734%27 HTTP/1.1" 200 None
2026-03-28 21:05:47 [auto1.it] INFO: Scrape type for ML20734: 0
2026-03-28 21:05:47 [auto1.it] INFO: Found listing with ID: HC48656
2026-03-28 21:05:47 [auto1.it] INFO: Found listing with ID: CZ22961
2026-03-28 21:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ22961%27 HTTP/1.1" 200 None
2026-03-28 21:05:47 [auto1.it] INFO: Scrape type for CZ22961: 0
2026-03-28 21:05:47 [auto1.it] INFO: Found listing with ID: GN54162
2026-03-28 21:05:47 [auto1.it] INFO: Found listing with ID: VS31933
2026-03-28 21:05:47 [auto1.it] INFO: Found listing with ID: RM05411
2026-03-28 21:05:47 [auto1.it] INFO: Found listing with ID: ZC19416
2026-03-28 21:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC19416%27 HTTP/1.1" 200 None
2026-03-28 21:05:47 [auto1.it] INFO: Scrape type for ZC19416: 0
2026-03-28 21:05:47 [auto1.it] INFO: Found listing with ID: DE25222
2026-03-28 21:05:47 [auto1.it] INFO: Found listing with ID: MA77848
2026-03-28 21:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA77848%27 HTTP/1.1" 200 None
2026-03-28 21:05:47 [auto1.it] INFO: Scrape type for MA77848: 0
2026-03-28 21:05:47 [auto1.it] INFO: Found listing with ID: YL89014
2026-03-28 21:05:47 [auto1.it] INFO: Found listing with ID: CF61926
2026-03-28 21:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF61926%27 HTTP/1.1" 200 None
2026-03-28 21:05:47 [auto1.it] INFO: Scrape type for CF61926: 0
2026-03-28 21:05:47 [auto1.it] INFO: Found listing with ID: ZS54460
2026-03-28 21:05:47 [auto1.it] INFO: Found listing with ID: HD82423
2026-03-28 21:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD82423%27 HTTP/1.1" 200 None
2026-03-28 21:05:47 [auto1.it] INFO: Scrape type for HD82423: 0
2026-03-28 21:05:47 [auto1.it] INFO: Found listing with ID: MU03817
2026-03-28 21:05:47 [auto1.it] INFO: Found listing with ID: AY21125
2026-03-28 21:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY21125%27 HTTP/1.1" 200 None
2026-03-28 21:05:47 [auto1.it] INFO: Scrape type for AY21125: 0
2026-03-28 21:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:48 [auto1.it] INFO: Channel: 24h | Page: 6 | totalHits: 2224 | hits on page: 40
2026-03-28 21:05:48 [auto1.it] INFO: Found listing with ID: XR42745
2026-03-28 21:05:48 [auto1.it] INFO: Found listing with ID: NW60366
2026-03-28 21:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW60366%27 HTTP/1.1" 200 None
2026-03-28 21:05:48 [auto1.it] INFO: Scrape type for NW60366: 0
2026-03-28 21:05:48 [auto1.it] INFO: Found listing with ID: WV42889
2026-03-28 21:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV42889%27 HTTP/1.1" 200 None
2026-03-28 21:05:48 [auto1.it] INFO: Scrape type for WV42889: 0
2026-03-28 21:05:48 [auto1.it] INFO: Found listing with ID: UE31204
2026-03-28 21:05:48 [auto1.it] INFO: Found listing with ID: EZ48642
2026-03-28 21:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ48642%27 HTTP/1.1" 200 None
2026-03-28 21:05:48 [auto1.it] INFO: Scrape type for EZ48642: 0
2026-03-28 21:05:48 [auto1.it] INFO: Found listing with ID: BM42520
2026-03-28 21:05:48 [auto1.it] INFO: Found listing with ID: KD02463
2026-03-28 21:05:48 [auto1.it] INFO: Found listing with ID: SL86512
2026-03-28 21:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL86512%27 HTTP/1.1" 200 None
2026-03-28 21:05:48 [auto1.it] INFO: Scrape type for SL86512: 0
2026-03-28 21:05:48 [auto1.it] INFO: Found listing with ID: AN97971
2026-03-28 21:05:48 [auto1.it] INFO: Found listing with ID: DN82434
2026-03-28 21:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN82434%27 HTTP/1.1" 200 None
2026-03-28 21:05:48 [auto1.it] INFO: Scrape type for DN82434: 0
2026-03-28 21:05:48 [auto1.it] INFO: Found listing with ID: SG31590
2026-03-28 21:05:48 [auto1.it] INFO: Found listing with ID: FP35914
2026-03-28 21:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP35914%27 HTTP/1.1" 200 None
2026-03-28 21:05:48 [auto1.it] INFO: Scrape type for FP35914: 0
2026-03-28 21:05:48 [auto1.it] INFO: Found listing with ID: RK20934
2026-03-28 21:05:48 [auto1.it] INFO: Found listing with ID: XN27965
2026-03-28 21:05:48 [auto1.it] INFO: Found listing with ID: ZY56429
2026-03-28 21:05:48 [auto1.it] INFO: Found listing with ID: VF40015
2026-03-28 21:05:48 [auto1.it] INFO: Found listing with ID: EC84941
2026-03-28 21:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC84941%27 HTTP/1.1" 200 None
2026-03-28 21:05:48 [auto1.it] INFO: Scrape type for EC84941: 0
2026-03-28 21:05:48 [auto1.it] INFO: Found listing with ID: JJ80566
2026-03-28 21:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ80566%27 HTTP/1.1" 200 None
2026-03-28 21:05:49 [auto1.it] INFO: Scrape type for JJ80566: 0
2026-03-28 21:05:49 [auto1.it] INFO: Found listing with ID: RL33082
2026-03-28 21:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL33082%27 HTTP/1.1" 200 None
2026-03-28 21:05:49 [auto1.it] INFO: Scrape type for RL33082: 0
2026-03-28 21:05:49 [auto1.it] INFO: Found listing with ID: EB44431
2026-03-28 21:05:49 [auto1.it] INFO: Found listing with ID: WX88611
2026-03-28 21:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WX88611%27 HTTP/1.1" 200 None
2026-03-28 21:05:49 [auto1.it] INFO: Scrape type for WX88611: 0
2026-03-28 21:05:49 [auto1.it] INFO: Found listing with ID: KS43685
2026-03-28 21:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS43685%27 HTTP/1.1" 200 None
2026-03-28 21:05:49 [auto1.it] INFO: Scrape type for KS43685: 0
2026-03-28 21:05:49 [auto1.it] INFO: Found listing with ID: FA16942
2026-03-28 21:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA16942%27 HTTP/1.1" 200 None
2026-03-28 21:05:49 [auto1.it] INFO: Scrape type for FA16942: 0
2026-03-28 21:05:49 [auto1.it] INFO: Found listing with ID: JF75950
2026-03-28 21:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF75950%27 HTTP/1.1" 200 None
2026-03-28 21:05:49 [auto1.it] INFO: Scrape type for JF75950: 0
2026-03-28 21:05:49 [auto1.it] INFO: Found listing with ID: NH64941
2026-03-28 21:05:49 [auto1.it] INFO: Found listing with ID: FE11339
2026-03-28 21:05:49 [auto1.it] INFO: Found listing with ID: TS34792
2026-03-28 21:05:49 [auto1.it] INFO: Found listing with ID: RY64752
2026-03-28 21:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY64752%27 HTTP/1.1" 200 None
2026-03-28 21:05:49 [auto1.it] INFO: Scrape type for RY64752: 0
2026-03-28 21:05:49 [auto1.it] INFO: Found listing with ID: CS00409
2026-03-28 21:05:49 [auto1.it] INFO: Found listing with ID: HD95534
2026-03-28 21:05:49 [auto1.it] INFO: Found listing with ID: ET79230
2026-03-28 21:05:49 [auto1.it] INFO: Found listing with ID: KL55117
2026-03-28 21:05:49 [auto1.it] INFO: Found listing with ID: CH57446
2026-03-28 21:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH57446%27 HTTP/1.1" 200 None
2026-03-28 21:05:49 [auto1.it] INFO: Scrape type for CH57446: 0
2026-03-28 21:05:49 [auto1.it] INFO: Found listing with ID: NC67394
2026-03-28 21:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC67394%27 HTTP/1.1" 200 None
2026-03-28 21:05:49 [auto1.it] INFO: Scrape type for NC67394: 0
2026-03-28 21:05:49 [auto1.it] INFO: Found listing with ID: KB12646
2026-03-28 21:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB12646%27 HTTP/1.1" 200 None
2026-03-28 21:05:49 [auto1.it] INFO: Scrape type for KB12646: 0
2026-03-28 21:05:49 [auto1.it] INFO: Found listing with ID: WM00919
2026-03-28 21:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM00919%27 HTTP/1.1" 200 None
2026-03-28 21:05:49 [auto1.it] INFO: Scrape type for WM00919: 0
2026-03-28 21:05:49 [auto1.it] INFO: Found listing with ID: ZD65765
2026-03-28 21:05:49 [auto1.it] INFO: Found listing with ID: UR83709
2026-03-28 21:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR83709%27 HTTP/1.1" 200 None
2026-03-28 21:05:49 [auto1.it] INFO: Scrape type for UR83709: 0
2026-03-28 21:05:49 [auto1.it] INFO: Found listing with ID: XJ91749
2026-03-28 21:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ91749%27 HTTP/1.1" 200 None
2026-03-28 21:05:49 [auto1.it] INFO: Scrape type for XJ91749: 0
2026-03-28 21:05:49 [auto1.it] INFO: Found listing with ID: JB13262
2026-03-28 21:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB13262%27 HTTP/1.1" 200 None
2026-03-28 21:05:49 [auto1.it] INFO: Scrape type for JB13262: 0
2026-03-28 21:05:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AU35917/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:50 [auto1.it] INFO: Channel: 24h | Page: 7 | totalHits: 2224 | hits on page: 40
2026-03-28 21:05:50 [auto1.it] INFO: Found listing with ID: RZ16714
2026-03-28 21:05:50 [auto1.it] INFO: Found listing with ID: JE85806
2026-03-28 21:05:50 [auto1.it] INFO: Found listing with ID: EV19228
2026-03-28 21:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV19228%27 HTTP/1.1" 200 None
2026-03-28 21:05:50 [auto1.it] INFO: Scrape type for EV19228: 0
2026-03-28 21:05:50 [auto1.it] INFO: Found listing with ID: TU38446
2026-03-28 21:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU38446%27 HTTP/1.1" 200 None
2026-03-28 21:05:50 [auto1.it] INFO: Scrape type for TU38446: 2
2026-03-28 21:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c86fcde-2ee5-5229-ab3f-598e68d557f5 with identifier: TU38446
2026-03-28 21:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c86fcde-2ee5-5229-ab3f-598e68d557f5 with scrape type 2
2026-03-28 21:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c86fcde-2ee5-5229-ab3f-598e68d557f5 with scrape type 2
2026-03-28 21:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5c86fcde-2ee5-5229-ab3f-598e68d557f5, identifier: TU38446
2026-03-28 21:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5c86fcde-2ee5-5229-ab3f-598e68d557f5 with identifier: TU38446
2026-03-28 21:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5c86fcde-2ee5-5229-ab3f-598e68d557f5 with identifier: TU38446
2026-03-28 21:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5c86fcde-2ee5-5229-ab3f-598e68d557f5 with identifier: TU38446 to the API
2026-03-28 21:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:04:43Z',
'fuel_type': 'hybrid',
'id': '5c86fcde-2ee5-5229-ab3f-598e68d557f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU38446',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 63098,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-28',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 250e Progressive',
'transmission': 'automatic',
'trim': 'Progressive',
'year': 2021}
2026-03-28 21:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU38446%27 HTTP/1.1" 200 None
2026-03-28 21:05:50 [auto1.it] INFO: Saving data for TU38446: {'auction_closing_time': 1774883083.0, 'created_time': 1773130177.446201, 'last_price_update_time': 1774731950.820556}
2026-03-28 21:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TU38446') HTTP/1.1" 204 0
2026-03-28 21:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:50 [auto1.it] INFO: Found listing with ID: AR28136
2026-03-28 21:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR28136%27 HTTP/1.1" 200 None
2026-03-28 21:05:50 [auto1.it] INFO: Scrape type for AR28136: 0
2026-03-28 21:05:50 [auto1.it] INFO: Found listing with ID: NL88933
2026-03-28 21:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL88933%27 HTTP/1.1" 200 None
2026-03-28 21:05:50 [auto1.it] INFO: Scrape type for NL88933: 0
2026-03-28 21:05:50 [auto1.it] INFO: Found listing with ID: CN88471
2026-03-28 21:05:50 [auto1.it] INFO: Found listing with ID: XX59557
2026-03-28 21:05:50 [auto1.it] INFO: Found listing with ID: EH45262
2026-03-28 21:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH45262%27 HTTP/1.1" 200 None
2026-03-28 21:05:50 [auto1.it] INFO: Scrape type for EH45262: 0
2026-03-28 21:05:50 [auto1.it] INFO: Found listing with ID: BV63915
2026-03-28 21:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV63915%27 HTTP/1.1" 200 None
2026-03-28 21:05:51 [auto1.it] INFO: Scrape type for BV63915: 1
2026-03-28 21:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AU35917> (referer: https://www.auto1.com/v1/car-details-view/AU35917/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: TH28502
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: KS79524
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: JU83939
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU83939%27 HTTP/1.1" 200 None
2026-03-28 21:05:51 [auto1.it] INFO: Scrape type for JU83939: 0
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: CN85628
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: WD53289
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: SE27388
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: FT94062
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT94062%27 HTTP/1.1" 200 None
2026-03-28 21:05:51 [auto1.it] INFO: Scrape type for FT94062: 0
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: DV90531
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: NX73202
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: PW65105
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: TT80777
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: LX11958
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX11958%27 HTTP/1.1" 200 None
2026-03-28 21:05:51 [auto1.it] INFO: Scrape type for LX11958: 0
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: BR63865
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: PA53057
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA53057%27 HTTP/1.1" 200 None
2026-03-28 21:05:51 [auto1.it] INFO: Scrape type for PA53057: 0
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: XW51036
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: RJ33574
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: DW12322
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW12322%27 HTTP/1.1" 200 None
2026-03-28 21:05:51 [auto1.it] INFO: Scrape type for DW12322: 0
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: RT39388
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: ET07404
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: ZR50624
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: GM86126
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM86126%27 HTTP/1.1" 200 None
2026-03-28 21:05:51 [auto1.it] INFO: Scrape type for GM86126: 0
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: DA24771
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: LE49462
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: GF15997
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF15997%27 HTTP/1.1" 200 None
2026-03-28 21:05:51 [auto1.it] INFO: Scrape type for GF15997: 0
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: MS58907
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: LR70211
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: WH19380
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: AL22636
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL22636%27 HTTP/1.1" 200 None
2026-03-28 21:05:51 [auto1.it] INFO: Scrape type for AL22636: 0
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: JT08977
2026-03-28 21:05:51 [auto1.it] INFO: Found listing with ID: MF61265
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MF61265%27 HTTP/1.1" 200 None
2026-03-28 21:05:51 [auto1.it] INFO: Scrape type for MF61265: 0
2026-03-28 21:05:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0394a111-a41c-564b-bb31-aa74bc77262a with identifier: AU35917
2026-03-28 21:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0394a111-a41c-564b-bb31-aa74bc77262a with scrape type 1
2026-03-28 21:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0394a111-a41c-564b-bb31-aa74bc77262a
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F68%252Ff468b17465c2d6369da9f80b2b3fedd0%252Fpa%252FAU35917_a0e2f01b6456f047c4ff3911b0480b10.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_a0e2f01b6456f047c4ff3911b0480b10.jpg already downloaded
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F68%252Ff468b17465c2d6369da9f80b2b3fedd0%252Fpa%252FAU35917_b142199a2bbe8de95b08d6a52f746681.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_b142199a2bbe8de95b08d6a52f746681.jpg already downloaded
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F68%252Ff468b17465c2d6369da9f80b2b3fedd0%252Fpa%252FAU35917_6cc542008fff106f44f0de7c00ec6f1f.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_6cc542008fff106f44f0de7c00ec6f1f.jpg already downloaded
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F68%252Ff468b17465c2d6369da9f80b2b3fedd0%252Fpa%252FAU35917_6d9b360fcbd5df2d36474bf01fe086ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_6d9b360fcbd5df2d36474bf01fe086ec.jpg already downloaded
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F68%252Ff468b17465c2d6369da9f80b2b3fedd0%252Fpa%252FAU35917_e7275607a940caa7ebef08d572904067.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_e7275607a940caa7ebef08d572904067.jpg already downloaded
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F68%252Ff468b17465c2d6369da9f80b2b3fedd0%252Fpa%252FAU35917_f1087ed25520bf95b5189d804a6b288e.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_f1087ed25520bf95b5189d804a6b288e.jpg already downloaded
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F68%252Ff468b17465c2d6369da9f80b2b3fedd0%252Fpa%252FAU35917_e98bcba75c0fe0facb2ec5c256f0db61.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_e98bcba75c0fe0facb2ec5c256f0db61.jpg already downloaded
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F68%252Ff468b17465c2d6369da9f80b2b3fedd0%252Fpa%252FAU35917_ee0020ec1ad3285c30db511655ec8893.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_ee0020ec1ad3285c30db511655ec8893.jpg already downloaded
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F68%252Ff468b17465c2d6369da9f80b2b3fedd0%252Fpa%252FAU35917_4e27808c55c726ea81e0bc3a0147981c.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_4e27808c55c726ea81e0bc3a0147981c.jpg already downloaded
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F68%252Ff468b17465c2d6369da9f80b2b3fedd0%252Fpa%252FAU35917_ec36941858fc0699bacaf25c1dbb55f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_ec36941858fc0699bacaf25c1dbb55f4.jpg already downloaded
2026-03-28 21:05:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0394a111-a41c-564b-bb31-aa74bc77262a, identifier: AU35917
2026-03-28 21:05:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0394a111-a41c-564b-bb31-aa74bc77262a with identifier: AU35917
2026-03-28 21:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0394a111-a41c-564b-bb31-aa74bc77262a with identifier: AU35917
2026-03-28 21:05:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0394a111-a41c-564b-bb31-aa74bc77262a with identifier: AU35917 to the API
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AU35917>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:36:00Z',
'fuel_type': 'diesel',
'id': '0394a111-a41c-564b-bb31-aa74bc77262a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU35917',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Land Rover',
'model': 'Discovery Sport',
'odometer': 73490,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_a0e2f01b6456f047c4ff3911b0480b10.jpg',
'https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_b142199a2bbe8de95b08d6a52f746681.jpg',
'https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_6cc542008fff106f44f0de7c00ec6f1f.jpg',
'https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_6d9b360fcbd5df2d36474bf01fe086ec.jpg',
'https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_e7275607a940caa7ebef08d572904067.jpg',
'https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_f1087ed25520bf95b5189d804a6b288e.jpg',
'https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_e98bcba75c0fe0facb2ec5c256f0db61.jpg',
'https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_ee0020ec1ad3285c30db511655ec8893.jpg',
'https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_4e27808c55c726ea81e0bc3a0147981c.jpg',
'https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_ec36941858fc0699bacaf25c1dbb55f4.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0394a111-a41c-564b-bb31-aa74bc77262a/0394a111-a41c-564b-bb31-aa74bc77262a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70415,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_a0e2f01b6456f047c4ff3911b0480b10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0394a111-a41c-564b-bb31-aa74bc77262a/0394a111-a41c-564b-bb31-aa74bc77262a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69516,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_b142199a2bbe8de95b08d6a52f746681.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0394a111-a41c-564b-bb31-aa74bc77262a/0394a111-a41c-564b-bb31-aa74bc77262a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71459,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_6cc542008fff106f44f0de7c00ec6f1f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0394a111-a41c-564b-bb31-aa74bc77262a/0394a111-a41c-564b-bb31-aa74bc77262a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53860,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_6d9b360fcbd5df2d36474bf01fe086ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0394a111-a41c-564b-bb31-aa74bc77262a/0394a111-a41c-564b-bb31-aa74bc77262a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67749,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_e7275607a940caa7ebef08d572904067.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0394a111-a41c-564b-bb31-aa74bc77262a/0394a111-a41c-564b-bb31-aa74bc77262a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65389,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_f1087ed25520bf95b5189d804a6b288e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0394a111-a41c-564b-bb31-aa74bc77262a/0394a111-a41c-564b-bb31-aa74bc77262a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50966,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_e98bcba75c0fe0facb2ec5c256f0db61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0394a111-a41c-564b-bb31-aa74bc77262a/0394a111-a41c-564b-bb31-aa74bc77262a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2533702,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_ee0020ec1ad3285c30db511655ec8893.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0394a111-a41c-564b-bb31-aa74bc77262a/0394a111-a41c-564b-bb31-aa74bc77262a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67154,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_4e27808c55c726ea81e0bc3a0147981c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0394a111-a41c-564b-bb31-aa74bc77262a/0394a111-a41c-564b-bb31-aa74bc77262a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64081,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/68/f468b17465c2d6369da9f80b2b3fedd0/pa/AU35917_ec36941858fc0699bacaf25c1dbb55f4.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-10',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Discovery Sport 2.0 Td4 HSE',
'transmission': 'automatic',
'trim': 'HSE',
'year': 2017}
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU35917%27 HTTP/1.1" 200 None
2026-03-28 21:05:51 [auto1.it] INFO: Saving data for AU35917: {'created_time': 1774731951.864864, 'last_price_update_time': 1774731951.864878, 'auction_closing_time': 1774884960.0}
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AU35917') HTTP/1.1" 204 0
2026-03-28 21:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KN64287/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BV63915/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:52 [auto1.it] INFO: Channel: 24h | Page: 8 | totalHits: 2224 | hits on page: 40
2026-03-28 21:05:52 [auto1.it] INFO: Found listing with ID: ZX69560
2026-03-28 21:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX69560%27 HTTP/1.1" 200 None
2026-03-28 21:05:52 [auto1.it] INFO: Scrape type for ZX69560: 1
2026-03-28 21:05:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:52 [auto1.it] INFO: Found listing with ID: CB33793
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB33793%27 HTTP/1.1" 200 None
2026-03-28 21:05:53 [auto1.it] INFO: Scrape type for CB33793: 0
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: ZC80598
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: EG89993
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG89993%27 HTTP/1.1" 200 None
2026-03-28 21:05:53 [auto1.it] INFO: Scrape type for EG89993: 0
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: KJ52341
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: KD49699
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: DN48840
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: MH68095
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH68095%27 HTTP/1.1" 200 None
2026-03-28 21:05:53 [auto1.it] INFO: Scrape type for MH68095: 0
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: HC25835
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC25835%27 HTTP/1.1" 200 None
2026-03-28 21:05:53 [auto1.it] INFO: Scrape type for HC25835: 0
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: VZ70094
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: FZ95983
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: RD83320
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD83320%27 HTTP/1.1" 200 None
2026-03-28 21:05:53 [auto1.it] INFO: Scrape type for RD83320: 0
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: KR95959
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: GP15834
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: HP12790
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: KD20323
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD20323%27 HTTP/1.1" 200 None
2026-03-28 21:05:53 [auto1.it] INFO: Scrape type for KD20323: 0
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: KT78402
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT78402%27 HTTP/1.1" 200 None
2026-03-28 21:05:53 [auto1.it] INFO: Scrape type for KT78402: 0
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: TZ23741
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ23741%27 HTTP/1.1" 200 None
2026-03-28 21:05:53 [auto1.it] INFO: Scrape type for TZ23741: 0
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: XT36875
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT36875%27 HTTP/1.1" 200 None
2026-03-28 21:05:53 [auto1.it] INFO: Scrape type for XT36875: 1
2026-03-28 21:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: ZL03111
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: TL13450
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: NC12493
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC12493%27 HTTP/1.1" 200 None
2026-03-28 21:05:53 [auto1.it] INFO: Scrape type for NC12493: 0
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: ZP73975
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP73975%27 HTTP/1.1" 200 None
2026-03-28 21:05:53 [auto1.it] INFO: Scrape type for ZP73975: 0
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: AY77506
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY77506%27 HTTP/1.1" 200 None
2026-03-28 21:05:53 [auto1.it] INFO: Scrape type for AY77506: 0
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: BT65910
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT65910%27 HTTP/1.1" 200 None
2026-03-28 21:05:53 [auto1.it] INFO: Scrape type for BT65910: 0
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: TW94655
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: ED22447
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED22447%27 HTTP/1.1" 200 None
2026-03-28 21:05:53 [auto1.it] INFO: Scrape type for ED22447: 0
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: XM03029
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: KZ49625
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ49625%27 HTTP/1.1" 200 None
2026-03-28 21:05:53 [auto1.it] INFO: Scrape type for KZ49625: 0
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: PZ63395
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ63395%27 HTTP/1.1" 200 None
2026-03-28 21:05:53 [auto1.it] INFO: Scrape type for PZ63395: 0
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: TY62021
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY62021%27 HTTP/1.1" 200 None
2026-03-28 21:05:53 [auto1.it] INFO: Scrape type for TY62021: 2
2026-03-28 21:05:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78adf71f-d0b5-5755-bacd-cde264a0da3e with identifier: TY62021
2026-03-28 21:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78adf71f-d0b5-5755-bacd-cde264a0da3e with scrape type 2
2026-03-28 21:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78adf71f-d0b5-5755-bacd-cde264a0da3e with scrape type 2
2026-03-28 21:05:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 78adf71f-d0b5-5755-bacd-cde264a0da3e, identifier: TY62021
2026-03-28 21:05:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 78adf71f-d0b5-5755-bacd-cde264a0da3e with identifier: TY62021
2026-03-28 21:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 78adf71f-d0b5-5755-bacd-cde264a0da3e with identifier: TY62021
2026-03-28 21:05:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 78adf71f-d0b5-5755-bacd-cde264a0da3e with identifier: TY62021 to the API
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:08:06Z',
'fuel_type': 'diesel',
'id': '78adf71f-d0b5-5755-bacd-cde264a0da3e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY62021',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 195000,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-08',
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2016}
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY62021%27 HTTP/1.1" 200 None
2026-03-28 21:05:53 [auto1.it] INFO: Saving data for TY62021: {'auction_closing_time': 1774883286.0, 'created_time': 1774645541.054968, 'last_price_update_time': 1774731953.773486}
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TY62021') HTTP/1.1" 204 0
2026-03-28 21:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: CW24266
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW24266%27 HTTP/1.1" 200 None
2026-03-28 21:05:53 [auto1.it] INFO: Scrape type for CW24266: 0
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: LX97199
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: BR49145
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR49145%27 HTTP/1.1" 200 None
2026-03-28 21:05:53 [auto1.it] INFO: Scrape type for BR49145: 0
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: CT62115
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT62115%27 HTTP/1.1" 200 None
2026-03-28 21:05:53 [auto1.it] INFO: Scrape type for CT62115: 0
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: ND06570
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ND06570%27 HTTP/1.1" 200 None
2026-03-28 21:05:53 [auto1.it] INFO: Scrape type for ND06570: 0
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: FX03621
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX03621%27 HTTP/1.1" 200 None
2026-03-28 21:05:53 [auto1.it] INFO: Scrape type for FX03621: 0
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: BX57696
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: SS09351
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS09351%27 HTTP/1.1" 200 None
2026-03-28 21:05:53 [auto1.it] INFO: Scrape type for SS09351: 0
2026-03-28 21:05:53 [auto1.it] INFO: Found listing with ID: PW70389
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW70389%27 HTTP/1.1" 200 None
2026-03-28 21:05:54 [auto1.it] INFO: Scrape type for PW70389: 0
2026-03-28 21:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KN64287> (referer: https://www.auto1.com/v1/car-details-view/KN64287/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f33d79d-74c5-5a79-9b80-278730b81d79 with identifier: KN64287
2026-03-28 21:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f33d79d-74c5-5a79-9b80-278730b81d79 with scrape type 1
2026-03-28 21:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1f33d79d-74c5-5a79-9b80-278730b81d79
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fb8%252Fcab8c27f973a3e17deef73c8c564d6ef%252Fpa%252FKN64287_e8132dfca7fe5e8baa35019214ffe949.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_e8132dfca7fe5e8baa35019214ffe949.jpg already downloaded
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fb8%252Fcab8c27f973a3e17deef73c8c564d6ef%252Fpa%252FKN64287_1a9f8dce66a079770e86aa5d3be41701.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_1a9f8dce66a079770e86aa5d3be41701.jpg already downloaded
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fb8%252Fcab8c27f973a3e17deef73c8c564d6ef%252Fpa%252FKN64287_5389b39457c3fc6835b9732a0ef9d456.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_5389b39457c3fc6835b9732a0ef9d456.jpg already downloaded
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fb8%252Fcab8c27f973a3e17deef73c8c564d6ef%252Fpa%252FKN64287_cf5491f4f2324f94f1c45959057edcc6.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_cf5491f4f2324f94f1c45959057edcc6.jpg already downloaded
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fb8%252Fcab8c27f973a3e17deef73c8c564d6ef%252Fpa%252FKN64287_506ebc1ed02cfcbc6768c5dcc54b1f6f.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_506ebc1ed02cfcbc6768c5dcc54b1f6f.jpg already downloaded
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fb8%252Fcab8c27f973a3e17deef73c8c564d6ef%252Fpa%252FKN64287_6d31e408bc0ad7b0b4dab666d9f0d796.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_6d31e408bc0ad7b0b4dab666d9f0d796.jpg already downloaded
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fb8%252Fcab8c27f973a3e17deef73c8c564d6ef%252Fpa%252FKN64287_6db8ff3630ebd35db2c10a86796bda76.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_6db8ff3630ebd35db2c10a86796bda76.jpg already downloaded
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fb8%252Fcab8c27f973a3e17deef73c8c564d6ef%252Fpa%252FKN64287_a610a2c332d624b9142aed10d90f12b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_a610a2c332d624b9142aed10d90f12b0.jpg already downloaded
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fb8%252Fcab8c27f973a3e17deef73c8c564d6ef%252Fpa%252FKN64287_0e7b88714dca93b5a6aec4498268018a.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_0e7b88714dca93b5a6aec4498268018a.jpg already downloaded
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fb8%252Fcab8c27f973a3e17deef73c8c564d6ef%252Fpa%252FKN64287_930280d006b449835f1769d642842381.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_930280d006b449835f1769d642842381.jpg already downloaded
2026-03-28 21:05:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1f33d79d-74c5-5a79-9b80-278730b81d79, identifier: KN64287
2026-03-28 21:05:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1f33d79d-74c5-5a79-9b80-278730b81d79 with identifier: KN64287
2026-03-28 21:05:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1f33d79d-74c5-5a79-9b80-278730b81d79 with identifier: KN64287
2026-03-28 21:05:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1f33d79d-74c5-5a79-9b80-278730b81d79 with identifier: KN64287 to the API
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KN64287>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:14:04Z',
'fuel_type': 'diesel',
'id': '1f33d79d-74c5-5a79-9b80-278730b81d79',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN64287',
'listing': 'auction',
'location': 'IT, Manoppello (PE)',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 137376,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_e8132dfca7fe5e8baa35019214ffe949.jpg',
'https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_1a9f8dce66a079770e86aa5d3be41701.jpg',
'https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_5389b39457c3fc6835b9732a0ef9d456.jpg',
'https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_cf5491f4f2324f94f1c45959057edcc6.jpg',
'https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_506ebc1ed02cfcbc6768c5dcc54b1f6f.jpg',
'https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_6d31e408bc0ad7b0b4dab666d9f0d796.jpg',
'https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_6db8ff3630ebd35db2c10a86796bda76.jpg',
'https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_a610a2c332d624b9142aed10d90f12b0.jpg',
'https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_0e7b88714dca93b5a6aec4498268018a.jpg',
'https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_930280d006b449835f1769d642842381.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f33d79d-74c5-5a79-9b80-278730b81d79/1f33d79d-74c5-5a79-9b80-278730b81d79_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2681033,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_e8132dfca7fe5e8baa35019214ffe949.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f33d79d-74c5-5a79-9b80-278730b81d79/1f33d79d-74c5-5a79-9b80-278730b81d79_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2129319,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_1a9f8dce66a079770e86aa5d3be41701.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f33d79d-74c5-5a79-9b80-278730b81d79/1f33d79d-74c5-5a79-9b80-278730b81d79_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2224825,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_5389b39457c3fc6835b9732a0ef9d456.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f33d79d-74c5-5a79-9b80-278730b81d79/1f33d79d-74c5-5a79-9b80-278730b81d79_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68177,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_cf5491f4f2324f94f1c45959057edcc6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f33d79d-74c5-5a79-9b80-278730b81d79/1f33d79d-74c5-5a79-9b80-278730b81d79_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2190541,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_506ebc1ed02cfcbc6768c5dcc54b1f6f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f33d79d-74c5-5a79-9b80-278730b81d79/1f33d79d-74c5-5a79-9b80-278730b81d79_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64001,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_6d31e408bc0ad7b0b4dab666d9f0d796.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f33d79d-74c5-5a79-9b80-278730b81d79/1f33d79d-74c5-5a79-9b80-278730b81d79_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2392830,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_6db8ff3630ebd35db2c10a86796bda76.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f33d79d-74c5-5a79-9b80-278730b81d79/1f33d79d-74c5-5a79-9b80-278730b81d79_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2299358,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_a610a2c332d624b9142aed10d90f12b0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f33d79d-74c5-5a79-9b80-278730b81d79/1f33d79d-74c5-5a79-9b80-278730b81d79_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70479,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_0e7b88714dca93b5a6aec4498268018a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f33d79d-74c5-5a79-9b80-278730b81d79/1f33d79d-74c5-5a79-9b80-278730b81d79_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44011,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgca/b8/cab8c27f973a3e17deef73c8c564d6ef/pa/KN64287_930280d006b449835f1769d642842381.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-06-25',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 Sportback 1.6 TDI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2015}
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KN64287%27 HTTP/1.1" 200 None
2026-03-28 21:05:54 [auto1.it] INFO: Saving data for KN64287: {'created_time': 1774731954.734896, 'last_price_update_time': 1774731954.734908, 'auction_closing_time': 1774883644.0}
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KN64287') HTTP/1.1" 204 0
2026-03-28 21:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BV63915> (referer: https://www.auto1.com/v1/car-details-view/BV63915/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:54 [auto1.it] INFO: Channel: 24h | Page: 9 | totalHits: 2224 | hits on page: 40
2026-03-28 21:05:54 [auto1.it] INFO: Found listing with ID: DA57942
2026-03-28 21:05:54 [auto1.it] INFO: Found listing with ID: MJ97902
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ97902%27 HTTP/1.1" 200 None
2026-03-28 21:05:54 [auto1.it] INFO: Scrape type for MJ97902: 0
2026-03-28 21:05:54 [auto1.it] INFO: Found listing with ID: EZ75087
2026-03-28 21:05:54 [auto1.it] INFO: Found listing with ID: BR31613
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR31613%27 HTTP/1.1" 200 None
2026-03-28 21:05:54 [auto1.it] INFO: Scrape type for BR31613: 0
2026-03-28 21:05:54 [auto1.it] INFO: Found listing with ID: FH51436
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH51436%27 HTTP/1.1" 200 None
2026-03-28 21:05:54 [auto1.it] INFO: Scrape type for FH51436: 0
2026-03-28 21:05:54 [auto1.it] INFO: Found listing with ID: FX08227
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX08227%27 HTTP/1.1" 200 None
2026-03-28 21:05:54 [auto1.it] INFO: Scrape type for FX08227: 0
2026-03-28 21:05:54 [auto1.it] INFO: Found listing with ID: AU78491
2026-03-28 21:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AU78491%27 HTTP/1.1" 200 None
2026-03-28 21:05:55 [auto1.it] INFO: Scrape type for AU78491: 0
2026-03-28 21:05:55 [auto1.it] INFO: Found listing with ID: ZY63215
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZY63215%27 HTTP/1.1" 200 None
2026-03-28 21:05:55 [auto1.it] INFO: Scrape type for ZY63215: 0
2026-03-28 21:05:55 [auto1.it] INFO: Found listing with ID: ST39288
2026-03-28 21:05:55 [auto1.it] INFO: Found listing with ID: EA21012
2026-03-28 21:05:55 [auto1.it] INFO: Found listing with ID: TH24600
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH24600%27 HTTP/1.1" 200 None
2026-03-28 21:05:55 [auto1.it] INFO: Scrape type for TH24600: 0
2026-03-28 21:05:55 [auto1.it] INFO: Found listing with ID: JZ39412
2026-03-28 21:05:55 [auto1.it] INFO: Found listing with ID: HD23157
2026-03-28 21:05:55 [auto1.it] INFO: Found listing with ID: UD54750
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD54750%27 HTTP/1.1" 200 None
2026-03-28 21:05:55 [auto1.it] INFO: Scrape type for UD54750: 0
2026-03-28 21:05:55 [auto1.it] INFO: Found listing with ID: GN89134
2026-03-28 21:05:55 [auto1.it] INFO: Found listing with ID: TU52552
2026-03-28 21:05:55 [auto1.it] INFO: Found listing with ID: SP76824
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP76824%27 HTTP/1.1" 200 None
2026-03-28 21:05:55 [auto1.it] INFO: Scrape type for SP76824: 0
2026-03-28 21:05:55 [auto1.it] INFO: Found listing with ID: NT95206
2026-03-28 21:05:55 [auto1.it] INFO: Found listing with ID: LK41226
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK41226%27 HTTP/1.1" 200 None
2026-03-28 21:05:55 [auto1.it] INFO: Scrape type for LK41226: 0
2026-03-28 21:05:55 [auto1.it] INFO: Found listing with ID: UC24034
2026-03-28 21:05:55 [auto1.it] INFO: Found listing with ID: ZW62743
2026-03-28 21:05:55 [auto1.it] INFO: Found listing with ID: SK49323
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK49323%27 HTTP/1.1" 200 None
2026-03-28 21:05:55 [auto1.it] INFO: Scrape type for SK49323: 0
2026-03-28 21:05:55 [auto1.it] INFO: Found listing with ID: YG84271
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG84271%27 HTTP/1.1" 200 None
2026-03-28 21:05:55 [auto1.it] INFO: Scrape type for YG84271: 0
2026-03-28 21:05:55 [auto1.it] INFO: Found listing with ID: MZ19905
2026-03-28 21:05:55 [auto1.it] INFO: Found listing with ID: DW53696
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW53696%27 HTTP/1.1" 200 None
2026-03-28 21:05:55 [auto1.it] INFO: Scrape type for DW53696: 0
2026-03-28 21:05:55 [auto1.it] INFO: Found listing with ID: SF43415
2026-03-28 21:05:55 [auto1.it] INFO: Found listing with ID: SV52525
2026-03-28 21:05:55 [auto1.it] INFO: Found listing with ID: HG71843
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG71843%27 HTTP/1.1" 200 None
2026-03-28 21:05:55 [auto1.it] INFO: Scrape type for HG71843: 2
2026-03-28 21:05:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4681d9fe-5889-5754-a9b9-7238e2085481 with identifier: HG71843
2026-03-28 21:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4681d9fe-5889-5754-a9b9-7238e2085481 with scrape type 2
2026-03-28 21:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4681d9fe-5889-5754-a9b9-7238e2085481 with scrape type 2
2026-03-28 21:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4681d9fe-5889-5754-a9b9-7238e2085481, identifier: HG71843
2026-03-28 21:05:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4681d9fe-5889-5754-a9b9-7238e2085481 with identifier: HG71843
2026-03-28 21:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4681d9fe-5889-5754-a9b9-7238e2085481 with identifier: HG71843
2026-03-28 21:05:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4681d9fe-5889-5754-a9b9-7238e2085481 with identifier: HG71843 to the API
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:04:00Z',
'fuel_type': 'diesel',
'id': '4681d9fe-5889-5754-a9b9-7238e2085481',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG71843',
'listing': 'auction',
'make': 'Fiat',
'model': '500L',
'odometer': 211074,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-27',
'seller_name': None,
'title': 'Fiat 500L 1.3 M-Jet Pop Star',
'transmission': 'manual',
'trim': 'Pop Star',
'year': 2017}
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG71843%27 HTTP/1.1" 200 None
2026-03-28 21:05:55 [auto1.it] INFO: Saving data for HG71843: {'auction_closing_time': 1774883040.0, 'created_time': 1774343221.554957, 'last_price_update_time': 1774731955.676905}
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HG71843') HTTP/1.1" 204 0
2026-03-28 21:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02164f10-b818-5b58-aad2-047559affbcf with identifier: BV63915
2026-03-28 21:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02164f10-b818-5b58-aad2-047559affbcf with scrape type 1
2026-03-28 21:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 02164f10-b818-5b58-aad2-047559affbcf
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fdd%252Fffdd1aa622952e5d01e5f0e915f2e145%252Fpa%252FBV63915_e606077c5d02ec41f7e2a53282f41fe8.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_e606077c5d02ec41f7e2a53282f41fe8.jpg already downloaded
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fdd%252Fffdd1aa622952e5d01e5f0e915f2e145%252Fpa%252FBV63915_57f91ffa2e5e9fdcc51647225affd127.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_57f91ffa2e5e9fdcc51647225affd127.jpg already downloaded
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fdd%252Fffdd1aa622952e5d01e5f0e915f2e145%252Fpa%252FBV63915_f517465ba3474df90332f34ddc14d146.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_f517465ba3474df90332f34ddc14d146.jpg already downloaded
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fdd%252Fffdd1aa622952e5d01e5f0e915f2e145%252Fpa%252FBV63915_cd2c44f1037b140e7f1fb0e6b6cd240b.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_cd2c44f1037b140e7f1fb0e6b6cd240b.jpg already downloaded
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fdd%252Fffdd1aa622952e5d01e5f0e915f2e145%252Fpa%252FBV63915_e24a2bb55b15cd2a3ba0accf4568a272.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_e24a2bb55b15cd2a3ba0accf4568a272.jpg already downloaded
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fdd%252Fffdd1aa622952e5d01e5f0e915f2e145%252Fpa%252FBV63915_b523afbbf7b32a3c1b722ab2dedc634c.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_b523afbbf7b32a3c1b722ab2dedc634c.jpg already downloaded
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fdd%252Fffdd1aa622952e5d01e5f0e915f2e145%252Fpa%252FBV63915_ab2003b5448a6ead17095c88c26a3c0c.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_ab2003b5448a6ead17095c88c26a3c0c.jpg already downloaded
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fdd%252Fffdd1aa622952e5d01e5f0e915f2e145%252Fpa%252FBV63915_acbb27c083c8fb6e1bd58d049225720a.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_acbb27c083c8fb6e1bd58d049225720a.jpg already downloaded
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fdd%252Fffdd1aa622952e5d01e5f0e915f2e145%252Fpa%252FBV63915_2e57e6bfc87492427e8c67060c5ca775.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_2e57e6bfc87492427e8c67060c5ca775.jpg already downloaded
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fdd%252Fffdd1aa622952e5d01e5f0e915f2e145%252Fpa%252FBV63915_091d6e98c44151ad24247fb44ae2ec1d.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_091d6e98c44151ad24247fb44ae2ec1d.jpg already downloaded
2026-03-28 21:05:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 02164f10-b818-5b58-aad2-047559affbcf, identifier: BV63915
2026-03-28 21:05:56 [auto1.it] INFO: Found listing with ID: VX04337
2026-03-28 21:05:56 [auto1.it] INFO: Found listing with ID: DD82932
2026-03-28 21:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD82932%27 HTTP/1.1" 200 None
2026-03-28 21:05:56 [auto1.it] INFO: Scrape type for DD82932: 0
2026-03-28 21:05:56 [auto1.it] INFO: Found listing with ID: NF97325
2026-03-28 21:05:56 [auto1.it] INFO: Found listing with ID: FK85417
2026-03-28 21:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK85417%27 HTTP/1.1" 200 None
2026-03-28 21:05:56 [auto1.it] INFO: Scrape type for FK85417: 0
2026-03-28 21:05:56 [auto1.it] INFO: Found listing with ID: SY54017
2026-03-28 21:05:56 [auto1.it] INFO: Found listing with ID: RN99841
2026-03-28 21:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN99841%27 HTTP/1.1" 200 None
2026-03-28 21:05:56 [auto1.it] INFO: Scrape type for RN99841: 0
2026-03-28 21:05:56 [auto1.it] INFO: Found listing with ID: CP55584
2026-03-28 21:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP55584%27 HTTP/1.1" 200 None
2026-03-28 21:05:56 [auto1.it] INFO: Scrape type for CP55584: 0
2026-03-28 21:05:56 [auto1.it] INFO: Found listing with ID: JR96571
2026-03-28 21:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR96571%27 HTTP/1.1" 200 None
2026-03-28 21:05:56 [auto1.it] INFO: Scrape type for JR96571: 0
2026-03-28 21:05:56 [auto1.it] INFO: Found listing with ID: YZ66981
2026-03-28 21:05:56 [auto1.it] INFO: Found listing with ID: GK72900
2026-03-28 21:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK72900%27 HTTP/1.1" 200 None
2026-03-28 21:05:56 [auto1.it] INFO: Scrape type for GK72900: 0
2026-03-28 21:05:56 [auto1.it] INFO: Found listing with ID: HE91199
2026-03-28 21:05:56 [auto1.it] INFO: Found listing with ID: FR96632
2026-03-28 21:05:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 02164f10-b818-5b58-aad2-047559affbcf with identifier: BV63915
2026-03-28 21:05:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 02164f10-b818-5b58-aad2-047559affbcf with identifier: BV63915
2026-03-28 21:05:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 02164f10-b818-5b58-aad2-047559affbcf with identifier: BV63915 to the API
2026-03-28 21:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BV63915>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:35:49Z',
'fuel_type': 'petrol',
'id': '02164f10-b818-5b58-aad2-047559affbcf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV63915',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'make': 'Lancia',
'model': 'Ypsilon',
'odometer': 128217,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_e606077c5d02ec41f7e2a53282f41fe8.jpg',
'https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_57f91ffa2e5e9fdcc51647225affd127.jpg',
'https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_f517465ba3474df90332f34ddc14d146.jpg',
'https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_cd2c44f1037b140e7f1fb0e6b6cd240b.jpg',
'https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_e24a2bb55b15cd2a3ba0accf4568a272.jpg',
'https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_b523afbbf7b32a3c1b722ab2dedc634c.jpg',
'https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_ab2003b5448a6ead17095c88c26a3c0c.jpg',
'https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_acbb27c083c8fb6e1bd58d049225720a.jpg',
'https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_2e57e6bfc87492427e8c67060c5ca775.jpg',
'https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_091d6e98c44151ad24247fb44ae2ec1d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02164f10-b818-5b58-aad2-047559affbcf/02164f10-b818-5b58-aad2-047559affbcf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65200,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_e606077c5d02ec41f7e2a53282f41fe8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02164f10-b818-5b58-aad2-047559affbcf/02164f10-b818-5b58-aad2-047559affbcf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58138,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_57f91ffa2e5e9fdcc51647225affd127.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02164f10-b818-5b58-aad2-047559affbcf/02164f10-b818-5b58-aad2-047559affbcf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67488,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_f517465ba3474df90332f34ddc14d146.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02164f10-b818-5b58-aad2-047559affbcf/02164f10-b818-5b58-aad2-047559affbcf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50464,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_cd2c44f1037b140e7f1fb0e6b6cd240b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02164f10-b818-5b58-aad2-047559affbcf/02164f10-b818-5b58-aad2-047559affbcf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58046,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_e24a2bb55b15cd2a3ba0accf4568a272.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02164f10-b818-5b58-aad2-047559affbcf/02164f10-b818-5b58-aad2-047559affbcf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64825,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_b523afbbf7b32a3c1b722ab2dedc634c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02164f10-b818-5b58-aad2-047559affbcf/02164f10-b818-5b58-aad2-047559affbcf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42683,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_ab2003b5448a6ead17095c88c26a3c0c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02164f10-b818-5b58-aad2-047559affbcf/02164f10-b818-5b58-aad2-047559affbcf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65599,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_acbb27c083c8fb6e1bd58d049225720a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02164f10-b818-5b58-aad2-047559affbcf/02164f10-b818-5b58-aad2-047559affbcf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64883,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_2e57e6bfc87492427e8c67060c5ca775.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02164f10-b818-5b58-aad2-047559affbcf/02164f10-b818-5b58-aad2-047559affbcf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2380035,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgff/dd/ffdd1aa622952e5d01e5f0e915f2e145/pa/BV63915_091d6e98c44151ad24247fb44ae2ec1d.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-02-28',
'seats_number': 4,
'seller_name': None,
'title': 'Lancia Ypsilon 1.2 Gold',
'transmission': 'manual',
'trim': 'Gold',
'year': 2016}
2026-03-28 21:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV63915%27 HTTP/1.1" 200 None
2026-03-28 21:05:56 [auto1.it] INFO: Saving data for BV63915: {'created_time': 1774731956.581419, 'last_price_update_time': 1774731956.581431, 'auction_closing_time': 1774884949.0}
2026-03-28 21:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BV63915') HTTP/1.1" 204 0
2026-03-28 21:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZX69560/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XT36875/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:57 [auto1.it] INFO: Channel: 24h | Page: 10 | totalHits: 2224 | hits on page: 40
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: TU01190
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: XN45534
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN45534%27 HTTP/1.1" 200 None
2026-03-28 21:05:57 [auto1.it] INFO: Scrape type for XN45534: 0
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: YG22381
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: CK25903
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: CS14469
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS14469%27 HTTP/1.1" 200 None
2026-03-28 21:05:57 [auto1.it] INFO: Scrape type for CS14469: 0
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: EC13131
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC13131%27 HTTP/1.1" 200 None
2026-03-28 21:05:57 [auto1.it] INFO: Scrape type for EC13131: 0
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: VR70375
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VR70375%27 HTTP/1.1" 200 None
2026-03-28 21:05:57 [auto1.it] INFO: Scrape type for VR70375: 0
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: WS86957
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: BE49358
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: NC51724
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: BD99197
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD99197%27 HTTP/1.1" 200 None
2026-03-28 21:05:57 [auto1.it] INFO: Scrape type for BD99197: 0
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: EN53386
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN53386%27 HTTP/1.1" 200 None
2026-03-28 21:05:57 [auto1.it] INFO: Scrape type for EN53386: 0
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: EW42527
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW42527%27 HTTP/1.1" 200 None
2026-03-28 21:05:57 [auto1.it] INFO: Scrape type for EW42527: 0
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: TJ19111
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ19111%27 HTTP/1.1" 200 None
2026-03-28 21:05:57 [auto1.it] INFO: Scrape type for TJ19111: 0
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: LX30829
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: SK41395
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: KX10481
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KX10481%27 HTTP/1.1" 200 None
2026-03-28 21:05:57 [auto1.it] INFO: Scrape type for KX10481: 0
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: AC58297
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: GB22303
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GB22303%27 HTTP/1.1" 200 None
2026-03-28 21:05:57 [auto1.it] INFO: Scrape type for GB22303: 0
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: YD65292
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: RG08819
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: VU11306
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU11306%27 HTTP/1.1" 200 None
2026-03-28 21:05:57 [auto1.it] INFO: Scrape type for VU11306: 0
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: JD40027
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD40027%27 HTTP/1.1" 200 None
2026-03-28 21:05:57 [auto1.it] INFO: Scrape type for JD40027: 0
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: TY97368
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY97368%27 HTTP/1.1" 200 None
2026-03-28 21:05:57 [auto1.it] INFO: Scrape type for TY97368: 0
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: BH88586
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: KF78303
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF78303%27 HTTP/1.1" 200 None
2026-03-28 21:05:57 [auto1.it] INFO: Scrape type for KF78303: 0
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: RL62360
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: LG34418
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: SK90576
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK90576%27 HTTP/1.1" 200 None
2026-03-28 21:05:57 [auto1.it] INFO: Scrape type for SK90576: 0
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: MT68027
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: GU05332
2026-03-28 21:05:57 [auto1.it] INFO: Found listing with ID: WW70884
2026-03-28 21:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW70884%27 HTTP/1.1" 200 None
2026-03-28 21:05:58 [auto1.it] INFO: Scrape type for WW70884: 0
2026-03-28 21:05:58 [auto1.it] INFO: Found listing with ID: AN40699
2026-03-28 21:05:58 [auto1.it] INFO: Found listing with ID: AT74871
2026-03-28 21:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT74871%27 HTTP/1.1" 200 None
2026-03-28 21:05:58 [auto1.it] INFO: Scrape type for AT74871: 2
2026-03-28 21:05:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4b9bdd9-cad9-5257-8dd0-d69e787fb3f0 with identifier: AT74871
2026-03-28 21:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4b9bdd9-cad9-5257-8dd0-d69e787fb3f0 with scrape type 2
2026-03-28 21:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4b9bdd9-cad9-5257-8dd0-d69e787fb3f0 with scrape type 2
2026-03-28 21:05:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a4b9bdd9-cad9-5257-8dd0-d69e787fb3f0, identifier: AT74871
2026-03-28 21:05:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a4b9bdd9-cad9-5257-8dd0-d69e787fb3f0 with identifier: AT74871
2026-03-28 21:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 21:05:58 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-28 21:05:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 21:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 21:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a4b9bdd9-cad9-5257-8dd0-d69e787fb3f0 with identifier: AT74871
2026-03-28 21:05:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a4b9bdd9-cad9-5257-8dd0-d69e787fb3f0 with identifier: AT74871 to the API
2026-03-28 21:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 67,
'expiration_date': '2026-03-30T15:21:36Z',
'fuel_type': 'petrol',
'id': 'a4b9bdd9-cad9-5257-8dd0-d69e787fb3f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT74871',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 28340,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-16',
'seller_name': None,
'title': 'Renault Clio 1.0 SCe Equilibre',
'transmission': 'manual',
'trim': 'Equilibre',
'year': 2023}
2026-03-28 21:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT74871%27 HTTP/1.1" 200 None
2026-03-28 21:05:58 [auto1.it] INFO: Saving data for AT74871: {'auction_closing_time': 1774884096.0, 'created_time': 1774127280.619329, 'last_price_update_time': 1774731958.655778}
2026-03-28 21:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AT74871') HTTP/1.1" 204 0
2026-03-28 21:05:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:05:58 [auto1.it] INFO: Found listing with ID: CK01527
2026-03-28 21:05:58 [auto1.it] INFO: Found listing with ID: BJ21664
2026-03-28 21:05:58 [auto1.it] INFO: Found listing with ID: FP22884
2026-03-28 21:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP22884%27 HTTP/1.1" 200 None
2026-03-28 21:05:58 [auto1.it] INFO: Scrape type for FP22884: 0
2026-03-28 21:05:58 [auto1.it] INFO: Found listing with ID: SN99997
2026-03-28 21:05:58 [auto1.it] INFO: Found listing with ID: YL87875
2026-03-28 21:05:58 [auto1.it] INFO: Found listing with ID: SP92634
2026-03-28 21:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XT36875> (referer: https://www.auto1.com/v1/car-details-view/XT36875/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZX69560> (referer: https://www.auto1.com/v1/car-details-view/ZX69560/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:05:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4eaac4d4-b385-5621-991b-e14291ac0730 with identifier: XT36875
2026-03-28 21:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4eaac4d4-b385-5621-991b-e14291ac0730 with scrape type 1
2026-03-28 21:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4eaac4d4-b385-5621-991b-e14291ac0730
2026-03-28 21:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F3d%252Ff63dcf3e0c0879d52acee9b339389ea6%252Fpa%252FXT36875_39f503898f23e109c2ed715535d24938.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/3d/f63dcf3e0c0879d52acee9b339389ea6/pa/XT36875_39f503898f23e109c2ed715535d24938.jpg already downloaded
2026-03-28 21:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F3d%252Ff63dcf3e0c0879d52acee9b339389ea6%252Fpa%252FXT36875_fdbf2e71588ed4e0636364aac51e1195.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/3d/f63dcf3e0c0879d52acee9b339389ea6/pa/XT36875_fdbf2e71588ed4e0636364aac51e1195.jpg already downloaded
2026-03-28 21:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F3d%252Ff63dcf3e0c0879d52acee9b339389ea6%252Fpa%252FXT36875_af5fcf9ba696e33b61c35d977f10b3af.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/3d/f63dcf3e0c0879d52acee9b339389ea6/pa/XT36875_af5fcf9ba696e33b61c35d977f10b3af.jpg already downloaded
2026-03-28 21:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F3d%252Ff63dcf3e0c0879d52acee9b339389ea6%252Fpa%252FXT36875_4da795dc3dd608aba865222d9e7e653b.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/3d/f63dcf3e0c0879d52acee9b339389ea6/pa/XT36875_4da795dc3dd608aba865222d9e7e653b.jpg already downloaded
2026-03-28 21:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F3d%252Ff63dcf3e0c0879d52acee9b339389ea6%252Fpa%252FXT36875_87ac172b898be87f8a6df1fc22ccde20.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/3d/f63dcf3e0c0879d52acee9b339389ea6/pa/XT36875_87ac172b898be87f8a6df1fc22ccde20.jpg already downloaded
2026-03-28 21:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4eaac4d4-b385-5621-991b-e14291ac0730, identifier: XT36875
2026-03-28 21:05:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c43752f-6817-5a89-9378-f94a0b9df1e9 with identifier: ZX69560
2026-03-28 21:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c43752f-6817-5a89-9378-f94a0b9df1e9 with scrape type 1
2026-03-28 21:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4c43752f-6817-5a89-9378-f94a0b9df1e9
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F18%252F92182b0e8fe7207e852d951e6dfdf775%252Fpa%252FZX69560_d0c9097dc488c2a9371577b906548a09.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_d0c9097dc488c2a9371577b906548a09.jpg not downloaded yet
2026-03-28 21:05:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4eaac4d4-b385-5621-991b-e14291ac0730 with identifier: XT36875
2026-03-28 21:05:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4eaac4d4-b385-5621-991b-e14291ac0730 with identifier: XT36875
2026-03-28 21:05:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4eaac4d4-b385-5621-991b-e14291ac0730 with identifier: XT36875 to the API
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:05:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XT36875>
{'auction_title': '',
'c_o_2_emission_value': 140,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.1L',
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:23:05Z',
'fuel_type': 'petrol',
'id': '4eaac4d4-b385-5621-991b-e14291ac0730',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT36875',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Citroen',
'model': 'C3',
'odometer': 66174,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/imgf6/3d/f63dcf3e0c0879d52acee9b339389ea6/pa/XT36875_39f503898f23e109c2ed715535d24938.jpg',
'https://img-pa.auto1.com/imgf6/3d/f63dcf3e0c0879d52acee9b339389ea6/pa/XT36875_fdbf2e71588ed4e0636364aac51e1195.jpg',
'https://img-pa.auto1.com/imgf6/3d/f63dcf3e0c0879d52acee9b339389ea6/pa/XT36875_af5fcf9ba696e33b61c35d977f10b3af.jpg',
'https://img-pa.auto1.com/imgf6/3d/f63dcf3e0c0879d52acee9b339389ea6/pa/XT36875_4da795dc3dd608aba865222d9e7e653b.jpg',
'https://img-pa.auto1.com/imgf6/3d/f63dcf3e0c0879d52acee9b339389ea6/pa/XT36875_87ac172b898be87f8a6df1fc22ccde20.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eaac4d4-b385-5621-991b-e14291ac0730/4eaac4d4-b385-5621-991b-e14291ac0730_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106079,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/3d/f63dcf3e0c0879d52acee9b339389ea6/pa/XT36875_39f503898f23e109c2ed715535d24938.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eaac4d4-b385-5621-991b-e14291ac0730/4eaac4d4-b385-5621-991b-e14291ac0730_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111592,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/3d/f63dcf3e0c0879d52acee9b339389ea6/pa/XT36875_fdbf2e71588ed4e0636364aac51e1195.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eaac4d4-b385-5621-991b-e14291ac0730/4eaac4d4-b385-5621-991b-e14291ac0730_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80909,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/3d/f63dcf3e0c0879d52acee9b339389ea6/pa/XT36875_af5fcf9ba696e33b61c35d977f10b3af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eaac4d4-b385-5621-991b-e14291ac0730/4eaac4d4-b385-5621-991b-e14291ac0730_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57309,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/3d/f63dcf3e0c0879d52acee9b339389ea6/pa/XT36875_4da795dc3dd608aba865222d9e7e653b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4eaac4d4-b385-5621-991b-e14291ac0730/4eaac4d4-b385-5621-991b-e14291ac0730_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63828,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/3d/f63dcf3e0c0879d52acee9b339389ea6/pa/XT36875_87ac172b898be87f8a6df1fc22ccde20.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-06-18',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.1 Confort',
'transmission': 'manual',
'trim': 'Confort',
'year': 2009}
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT36875%27 HTTP/1.1" 200 None
2026-03-28 21:05:59 [auto1.it] INFO: Saving data for XT36875: {'created_time': 1774731959.482231, 'last_price_update_time': 1774731959.482242, 'auction_closing_time': 1774884185.0}
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XT36875') HTTP/1.1" 204 0
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F18%252F92182b0e8fe7207e852d951e6dfdf775%252Fpa%252FZX69560_43b5d55d2fd2cb18b2cfd45c008b19da.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_43b5d55d2fd2cb18b2cfd45c008b19da.jpg not downloaded yet
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F18%252F92182b0e8fe7207e852d951e6dfdf775%252Fpa%252FZX69560_94ecce53ca9984102e501c57c4c46dff.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_94ecce53ca9984102e501c57c4c46dff.jpg not downloaded yet
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F18%252F92182b0e8fe7207e852d951e6dfdf775%252Fpa%252FZX69560_d227b26802c54c4fb04407bf5a34e2df.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_d227b26802c54c4fb04407bf5a34e2df.jpg not downloaded yet
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F18%252F92182b0e8fe7207e852d951e6dfdf775%252Fpa%252FZX69560_e62c8de8f5a7137f1dd85880f14e1295.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_e62c8de8f5a7137f1dd85880f14e1295.jpg not downloaded yet
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F18%252F92182b0e8fe7207e852d951e6dfdf775%252Fpa%252FZX69560_dfd72b0e34a9f2f23fd34ae686a1982b.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_dfd72b0e34a9f2f23fd34ae686a1982b.jpg not downloaded yet
2026-03-28 21:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_d0c9097dc488c2a9371577b906548a09.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F18%252F92182b0e8fe7207e852d951e6dfdf775%252Fpa%252FZX69560_5454330cef88f00b8a08b22f10bb0bdb.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_5454330cef88f00b8a08b22f10bb0bdb.jpg not downloaded yet
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F18%252F92182b0e8fe7207e852d951e6dfdf775%252Fpa%252FZX69560_bdcb10aba04b9d4dabec8f007f741ff0.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_bdcb10aba04b9d4dabec8f007f741ff0.jpg not downloaded yet
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F18%252F92182b0e8fe7207e852d951e6dfdf775%252Fpa%252FZX69560_39e870b203cb6a2c14a311b5dd6dae34.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_39e870b203cb6a2c14a311b5dd6dae34.jpg not downloaded yet
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F18%252F92182b0e8fe7207e852d951e6dfdf775%252Fpa%252FZX69560_08ac4f77c7c86bb37253254c862b9573.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_08ac4f77c7c86bb37253254c862b9573.jpg not downloaded yet
2026-03-28 21:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b85dbe790>
2026-03-28 21:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c43752f-6817-5a89-9378-f94a0b9df1e9/4c43752f-6817-5a89-9378-f94a0b9df1e9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F18%252F92182b0e8fe7207e852d951e6dfdf775%252Fpa%252FZX69560_d0c9097dc488c2a9371577b906548a09.jpg') HTTP/1.1" 204 0
2026-03-28 21:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_d0c9097dc488c2a9371577b906548a09.jpg saved to cache
2026-03-28 21:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c43752f-6817-5a89-9378-f94a0b9df1e9
2026-03-28 21:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_d227b26802c54c4fb04407bf5a34e2df.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_43b5d55d2fd2cb18b2cfd45c008b19da.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_94ecce53ca9984102e501c57c4c46dff.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_dfd72b0e34a9f2f23fd34ae686a1982b.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_e62c8de8f5a7137f1dd85880f14e1295.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7f7c94d0>
2026-03-28 21:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c43752f-6817-5a89-9378-f94a0b9df1e9/4c43752f-6817-5a89-9378-f94a0b9df1e9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F18%252F92182b0e8fe7207e852d951e6dfdf775%252Fpa%252FZX69560_d227b26802c54c4fb04407bf5a34e2df.jpg') HTTP/1.1" 204 0
2026-03-28 21:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_d227b26802c54c4fb04407bf5a34e2df.jpg saved to cache
2026-03-28 21:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c43752f-6817-5a89-9378-f94a0b9df1e9
2026-03-28 21:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8424e850>
2026-03-28 21:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c43752f-6817-5a89-9378-f94a0b9df1e9/4c43752f-6817-5a89-9378-f94a0b9df1e9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F18%252F92182b0e8fe7207e852d951e6dfdf775%252Fpa%252FZX69560_43b5d55d2fd2cb18b2cfd45c008b19da.jpg') HTTP/1.1" 204 0
2026-03-28 21:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_43b5d55d2fd2cb18b2cfd45c008b19da.jpg saved to cache
2026-03-28 21:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c43752f-6817-5a89-9378-f94a0b9df1e9
2026-03-28 21:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_08ac4f77c7c86bb37253254c862b9573.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b85be6210>
2026-03-28 21:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c43752f-6817-5a89-9378-f94a0b9df1e9/4c43752f-6817-5a89-9378-f94a0b9df1e9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F18%252F92182b0e8fe7207e852d951e6dfdf775%252Fpa%252FZX69560_94ecce53ca9984102e501c57c4c46dff.jpg') HTTP/1.1" 204 0
2026-03-28 21:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_94ecce53ca9984102e501c57c4c46dff.jpg saved to cache
2026-03-28 21:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c43752f-6817-5a89-9378-f94a0b9df1e9
2026-03-28 21:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8421fcd0>
2026-03-28 21:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c43752f-6817-5a89-9378-f94a0b9df1e9/4c43752f-6817-5a89-9378-f94a0b9df1e9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F18%252F92182b0e8fe7207e852d951e6dfdf775%252Fpa%252FZX69560_dfd72b0e34a9f2f23fd34ae686a1982b.jpg') HTTP/1.1" 204 0
2026-03-28 21:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_dfd72b0e34a9f2f23fd34ae686a1982b.jpg saved to cache
2026-03-28 21:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c43752f-6817-5a89-9378-f94a0b9df1e9
2026-03-28 21:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8430cb90>
2026-03-28 21:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c43752f-6817-5a89-9378-f94a0b9df1e9/4c43752f-6817-5a89-9378-f94a0b9df1e9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F18%252F92182b0e8fe7207e852d951e6dfdf775%252Fpa%252FZX69560_e62c8de8f5a7137f1dd85880f14e1295.jpg') HTTP/1.1" 204 0
2026-03-28 21:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_e62c8de8f5a7137f1dd85880f14e1295.jpg saved to cache
2026-03-28 21:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c43752f-6817-5a89-9378-f94a0b9df1e9
2026-03-28 21:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_bdcb10aba04b9d4dabec8f007f741ff0.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_5454330cef88f00b8a08b22f10bb0bdb.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_39e870b203cb6a2c14a311b5dd6dae34.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84284fd0>
2026-03-28 21:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c43752f-6817-5a89-9378-f94a0b9df1e9/4c43752f-6817-5a89-9378-f94a0b9df1e9_image_9.jpg HTTP/1.1" 201 0
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F18%252F92182b0e8fe7207e852d951e6dfdf775%252Fpa%252FZX69560_08ac4f77c7c86bb37253254c862b9573.jpg') HTTP/1.1" 204 0
2026-03-28 21:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_08ac4f77c7c86bb37253254c862b9573.jpg saved to cache
2026-03-28 21:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4c43752f-6817-5a89-9378-f94a0b9df1e9
2026-03-28 21:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7f747ad0>
2026-03-28 21:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c43752f-6817-5a89-9378-f94a0b9df1e9/4c43752f-6817-5a89-9378-f94a0b9df1e9_image_7.jpg HTTP/1.1" 201 0
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F18%252F92182b0e8fe7207e852d951e6dfdf775%252Fpa%252FZX69560_bdcb10aba04b9d4dabec8f007f741ff0.jpg') HTTP/1.1" 204 0
2026-03-28 21:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_bdcb10aba04b9d4dabec8f007f741ff0.jpg saved to cache
2026-03-28 21:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c43752f-6817-5a89-9378-f94a0b9df1e9
2026-03-28 21:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7f7c90d0>
2026-03-28 21:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c43752f-6817-5a89-9378-f94a0b9df1e9/4c43752f-6817-5a89-9378-f94a0b9df1e9_image_6.jpg HTTP/1.1" 201 0
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F18%252F92182b0e8fe7207e852d951e6dfdf775%252Fpa%252FZX69560_5454330cef88f00b8a08b22f10bb0bdb.jpg') HTTP/1.1" 204 0
2026-03-28 21:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_5454330cef88f00b8a08b22f10bb0bdb.jpg saved to cache
2026-03-28 21:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c43752f-6817-5a89-9378-f94a0b9df1e9
2026-03-28 21:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84314050>
2026-03-28 21:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c43752f-6817-5a89-9378-f94a0b9df1e9/4c43752f-6817-5a89-9378-f94a0b9df1e9_image_8.jpg HTTP/1.1" 201 0
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F18%252F92182b0e8fe7207e852d951e6dfdf775%252Fpa%252FZX69560_39e870b203cb6a2c14a311b5dd6dae34.jpg') HTTP/1.1" 204 0
2026-03-28 21:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_39e870b203cb6a2c14a311b5dd6dae34.jpg saved to cache
2026-03-28 21:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4c43752f-6817-5a89-9378-f94a0b9df1e9
2026-03-28 21:06:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c43752f-6817-5a89-9378-f94a0b9df1e9, skipping ID generation
2026-03-28 21:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c43752f-6817-5a89-9378-f94a0b9df1e9 with scrape type 1
2026-03-28 21:06:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c43752f-6817-5a89-9378-f94a0b9df1e9 sending to next pipeline
2026-03-28 21:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4c43752f-6817-5a89-9378-f94a0b9df1e9, identifier: ZX69560
2026-03-28 21:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4c43752f-6817-5a89-9378-f94a0b9df1e9 with identifier: ZX69560
2026-03-28 21:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4c43752f-6817-5a89-9378-f94a0b9df1e9 with identifier: ZX69560
2026-03-28 21:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4c43752f-6817-5a89-9378-f94a0b9df1e9 with identifier: ZX69560 to the API
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_39e870b203cb6a2c14a311b5dd6dae34.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:06:06Z',
'fuel_type': 'petrol',
'id': '4c43752f-6817-5a89-9378-f94a0b9df1e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX69560',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Peugeot',
'model': '2008',
'odometer': 77833,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c43752f-6817-5a89-9378-f94a0b9df1e9/4c43752f-6817-5a89-9378-f94a0b9df1e9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65311,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_d0c9097dc488c2a9371577b906548a09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c43752f-6817-5a89-9378-f94a0b9df1e9/4c43752f-6817-5a89-9378-f94a0b9df1e9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58331,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_43b5d55d2fd2cb18b2cfd45c008b19da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c43752f-6817-5a89-9378-f94a0b9df1e9/4c43752f-6817-5a89-9378-f94a0b9df1e9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58471,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_94ecce53ca9984102e501c57c4c46dff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c43752f-6817-5a89-9378-f94a0b9df1e9/4c43752f-6817-5a89-9378-f94a0b9df1e9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49547,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_d227b26802c54c4fb04407bf5a34e2df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c43752f-6817-5a89-9378-f94a0b9df1e9/4c43752f-6817-5a89-9378-f94a0b9df1e9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57708,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_e62c8de8f5a7137f1dd85880f14e1295.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c43752f-6817-5a89-9378-f94a0b9df1e9/4c43752f-6817-5a89-9378-f94a0b9df1e9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57123,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_dfd72b0e34a9f2f23fd34ae686a1982b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c43752f-6817-5a89-9378-f94a0b9df1e9/4c43752f-6817-5a89-9378-f94a0b9df1e9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45395,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_5454330cef88f00b8a08b22f10bb0bdb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c43752f-6817-5a89-9378-f94a0b9df1e9/4c43752f-6817-5a89-9378-f94a0b9df1e9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59717,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_bdcb10aba04b9d4dabec8f007f741ff0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c43752f-6817-5a89-9378-f94a0b9df1e9/4c43752f-6817-5a89-9378-f94a0b9df1e9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62381,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_39e870b203cb6a2c14a311b5dd6dae34.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c43752f-6817-5a89-9378-f94a0b9df1e9/4c43752f-6817-5a89-9378-f94a0b9df1e9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58113,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/18/92182b0e8fe7207e852d951e6dfdf775/pa/ZX69560_08ac4f77c7c86bb37253254c862b9573.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-01-26',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 VTi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2015}
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX69560%27 HTTP/1.1" 200 None
2026-03-28 21:06:00 [auto1.it] INFO: Saving data for ZX69560: {'created_time': 1774731960.758233, 'last_price_update_time': 1774731960.758245, 'auction_closing_time': 1774883166.0}
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZX69560') HTTP/1.1" 204 0
2026-03-28 21:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:00 [auto1.it] INFO: Channel: 24h | Page: 11 | totalHits: 2224 | hits on page: 40
2026-03-28 21:06:00 [auto1.it] INFO: Found listing with ID: AH31892
2026-03-28 21:06:00 [auto1.it] INFO: Found listing with ID: ZE89719
2026-03-28 21:06:00 [auto1.it] INFO: Found listing with ID: RE87143
2026-03-28 21:06:00 [auto1.it] INFO: Found listing with ID: FH04610
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH04610%27 HTTP/1.1" 200 None
2026-03-28 21:06:00 [auto1.it] INFO: Scrape type for FH04610: 0
2026-03-28 21:06:00 [auto1.it] INFO: Found listing with ID: TG60202
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG60202%27 HTTP/1.1" 200 None
2026-03-28 21:06:00 [auto1.it] INFO: Scrape type for TG60202: 0
2026-03-28 21:06:00 [auto1.it] INFO: Found listing with ID: PU90509
2026-03-28 21:06:00 [auto1.it] INFO: Found listing with ID: BJ73113
2026-03-28 21:06:00 [auto1.it] INFO: Found listing with ID: TX50484
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TX50484%27 HTTP/1.1" 200 None
2026-03-28 21:06:00 [auto1.it] INFO: Scrape type for TX50484: 0
2026-03-28 21:06:00 [auto1.it] INFO: Found listing with ID: XF07692
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF07692%27 HTTP/1.1" 200 None
2026-03-28 21:06:00 [auto1.it] INFO: Scrape type for XF07692: 0
2026-03-28 21:06:00 [auto1.it] INFO: Found listing with ID: DE48831
2026-03-28 21:06:00 [auto1.it] INFO: Found listing with ID: PG69305
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG69305%27 HTTP/1.1" 200 None
2026-03-28 21:06:00 [auto1.it] INFO: Scrape type for PG69305: 0
2026-03-28 21:06:00 [auto1.it] INFO: Found listing with ID: JU23021
2026-03-28 21:06:00 [auto1.it] INFO: Found listing with ID: JS62412
2026-03-28 21:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS62412%27 HTTP/1.1" 200 None
2026-03-28 21:06:01 [auto1.it] INFO: Scrape type for JS62412: 0
2026-03-28 21:06:01 [auto1.it] INFO: Found listing with ID: RW64625
2026-03-28 21:06:01 [auto1.it] INFO: Found listing with ID: WX67440
2026-03-28 21:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WX67440%27 HTTP/1.1" 200 None
2026-03-28 21:06:01 [auto1.it] INFO: Scrape type for WX67440: 0
2026-03-28 21:06:01 [auto1.it] INFO: Found listing with ID: ZR26877
2026-03-28 21:06:01 [auto1.it] INFO: Found listing with ID: YF34065
2026-03-28 21:06:01 [auto1.it] INFO: Found listing with ID: SE55523
2026-03-28 21:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE55523%27 HTTP/1.1" 200 None
2026-03-28 21:06:01 [auto1.it] INFO: Scrape type for SE55523: 2
2026-03-28 21:06:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 883fff77-02ec-54be-ba9c-28eb7c8a3725 with identifier: SE55523
2026-03-28 21:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 883fff77-02ec-54be-ba9c-28eb7c8a3725 with scrape type 2
2026-03-28 21:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 883fff77-02ec-54be-ba9c-28eb7c8a3725 with scrape type 2
2026-03-28 21:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 883fff77-02ec-54be-ba9c-28eb7c8a3725, identifier: SE55523
2026-03-28 21:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 883fff77-02ec-54be-ba9c-28eb7c8a3725 with identifier: SE55523
2026-03-28 21:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 883fff77-02ec-54be-ba9c-28eb7c8a3725 with identifier: SE55523
2026-03-28 21:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 883fff77-02ec-54be-ba9c-28eb7c8a3725 with identifier: SE55523 to the API
2026-03-28 21:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:34:09Z',
'fuel_type': 'diesel',
'id': '883fff77-02ec-54be-ba9c-28eb7c8a3725',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE55523',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra GTC',
'odometer': 298181,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-09-11',
'seller_name': None,
'title': 'Opel Astra GTC 1.7 CDTI Edition twenty-5',
'transmission': 'manual',
'trim': 'Edition twenty-5',
'year': 2008}
2026-03-28 21:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE55523%27 HTTP/1.1" 200 None
2026-03-28 21:06:01 [auto1.it] INFO: Saving data for SE55523: {'auction_closing_time': 1774884849.0, 'created_time': 1773421051.9077, 'last_price_update_time': 1774731961.460233}
2026-03-28 21:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SE55523') HTTP/1.1" 204 0
2026-03-28 21:06:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:01 [auto1.it] INFO: Found listing with ID: CV31826
2026-03-28 21:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV31826%27 HTTP/1.1" 200 None
2026-03-28 21:06:01 [auto1.it] INFO: Scrape type for CV31826: 0
2026-03-28 21:06:01 [auto1.it] INFO: Found listing with ID: MN82158
2026-03-28 21:06:01 [auto1.it] INFO: Found listing with ID: NJ83998
2026-03-28 21:06:01 [auto1.it] INFO: Found listing with ID: TK22539
2026-03-28 21:06:01 [auto1.it] INFO: Found listing with ID: NW47878
2026-03-28 21:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW47878%27 HTTP/1.1" 200 None
2026-03-28 21:06:01 [auto1.it] INFO: Scrape type for NW47878: 1
2026-03-28 21:06:01 [auto1.it] INFO: Found listing with ID: TZ83635
2026-03-28 21:06:01 [auto1.it] INFO: Found listing with ID: XY34648
2026-03-28 21:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY34648%27 HTTP/1.1" 200 None
2026-03-28 21:06:01 [auto1.it] INFO: Scrape type for XY34648: 0
2026-03-28 21:06:01 [auto1.it] INFO: Found listing with ID: XJ39556
2026-03-28 21:06:01 [auto1.it] INFO: Found listing with ID: WH83035
2026-03-28 21:06:01 [auto1.it] INFO: Found listing with ID: PG99334
2026-03-28 21:06:01 [auto1.it] INFO: Found listing with ID: BC39052
2026-03-28 21:06:01 [auto1.it] INFO: Found listing with ID: HS01763
2026-03-28 21:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS01763%27 HTTP/1.1" 200 None
2026-03-28 21:06:01 [auto1.it] INFO: Scrape type for HS01763: 0
2026-03-28 21:06:01 [auto1.it] INFO: Found listing with ID: HY24657
2026-03-28 21:06:01 [auto1.it] INFO: Found listing with ID: TL14575
2026-03-28 21:06:01 [auto1.it] INFO: Found listing with ID: RC58822
2026-03-28 21:06:01 [auto1.it] INFO: Found listing with ID: KB32662
2026-03-28 21:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KB32662%27 HTTP/1.1" 200 None
2026-03-28 21:06:01 [auto1.it] INFO: Scrape type for KB32662: 0
2026-03-28 21:06:01 [auto1.it] INFO: Found listing with ID: GX95672
2026-03-28 21:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX95672%27 HTTP/1.1" 200 None
2026-03-28 21:06:01 [auto1.it] INFO: Scrape type for GX95672: 0
2026-03-28 21:06:01 [auto1.it] INFO: Found listing with ID: FT43083
2026-03-28 21:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT43083%27 HTTP/1.1" 200 None
2026-03-28 21:06:01 [auto1.it] INFO: Scrape type for FT43083: 0
2026-03-28 21:06:01 [auto1.it] INFO: Found listing with ID: KW54926
2026-03-28 21:06:01 [auto1.it] INFO: Found listing with ID: GD67829
2026-03-28 21:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD67829%27 HTTP/1.1" 200 None
2026-03-28 21:06:01 [auto1.it] INFO: Scrape type for GD67829: 0
2026-03-28 21:06:01 [auto1.it] INFO: Found listing with ID: CW25523
2026-03-28 21:06:01 [auto1.it] INFO: Found listing with ID: NC97185
2026-03-28 21:06:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:02 [auto1.it] INFO: Channel: 24h | Page: 12 | totalHits: 2224 | hits on page: 40
2026-03-28 21:06:02 [auto1.it] INFO: Found listing with ID: MH53431
2026-03-28 21:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH53431%27 HTTP/1.1" 200 None
2026-03-28 21:06:02 [auto1.it] INFO: Scrape type for MH53431: 0
2026-03-28 21:06:02 [auto1.it] INFO: Found listing with ID: XR70694
2026-03-28 21:06:02 [auto1.it] INFO: Found listing with ID: MS98879
2026-03-28 21:06:02 [auto1.it] INFO: Found listing with ID: GW90153
2026-03-28 21:06:02 [auto1.it] INFO: Found listing with ID: XM00417
2026-03-28 21:06:02 [auto1.it] INFO: Found listing with ID: HZ95408
2026-03-28 21:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ95408%27 HTTP/1.1" 200 None
2026-03-28 21:06:02 [auto1.it] INFO: Scrape type for HZ95408: 0
2026-03-28 21:06:02 [auto1.it] INFO: Found listing with ID: EK65593
2026-03-28 21:06:02 [auto1.it] INFO: Found listing with ID: TT44801
2026-03-28 21:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT44801%27 HTTP/1.1" 200 None
2026-03-28 21:06:02 [auto1.it] INFO: Scrape type for TT44801: 0
2026-03-28 21:06:02 [auto1.it] INFO: Found listing with ID: ZV86353
2026-03-28 21:06:02 [auto1.it] INFO: Found listing with ID: CU49337
2026-03-28 21:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU49337%27 HTTP/1.1" 200 None
2026-03-28 21:06:02 [auto1.it] INFO: Scrape type for CU49337: 0
2026-03-28 21:06:02 [auto1.it] INFO: Found listing with ID: AG84200
2026-03-28 21:06:02 [auto1.it] INFO: Found listing with ID: YX87347
2026-03-28 21:06:02 [auto1.it] INFO: Found listing with ID: UW94573
2026-03-28 21:06:02 [auto1.it] INFO: Found listing with ID: WN29902
2026-03-28 21:06:02 [auto1.it] INFO: Found listing with ID: GA39078
2026-03-28 21:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA39078%27 HTTP/1.1" 200 None
2026-03-28 21:06:02 [auto1.it] INFO: Scrape type for GA39078: 0
2026-03-28 21:06:02 [auto1.it] INFO: Found listing with ID: HF24893
2026-03-28 21:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF24893%27 HTTP/1.1" 200 None
2026-03-28 21:06:02 [auto1.it] INFO: Scrape type for HF24893: 0
2026-03-28 21:06:02 [auto1.it] INFO: Found listing with ID: KZ16799
2026-03-28 21:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ16799%27 HTTP/1.1" 200 None
2026-03-28 21:06:02 [auto1.it] INFO: Scrape type for KZ16799: 0
2026-03-28 21:06:02 [auto1.it] INFO: Found listing with ID: SR16589
2026-03-28 21:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR16589%27 HTTP/1.1" 200 None
2026-03-28 21:06:02 [auto1.it] INFO: Scrape type for SR16589: 0
2026-03-28 21:06:02 [auto1.it] INFO: Found listing with ID: YT67370
2026-03-28 21:06:02 [auto1.it] INFO: Found listing with ID: FZ10631
2026-03-28 21:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ10631%27 HTTP/1.1" 200 None
2026-03-28 21:06:02 [auto1.it] INFO: Scrape type for FZ10631: 0
2026-03-28 21:06:02 [auto1.it] INFO: Found listing with ID: NL55256
2026-03-28 21:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL55256%27 HTTP/1.1" 200 None
2026-03-28 21:06:02 [auto1.it] INFO: Scrape type for NL55256: 2
2026-03-28 21:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6806f8b8-6ac5-58b3-b15b-9a2eee500b2c with identifier: NL55256
2026-03-28 21:06:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6806f8b8-6ac5-58b3-b15b-9a2eee500b2c with scrape type 2
2026-03-28 21:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6806f8b8-6ac5-58b3-b15b-9a2eee500b2c with scrape type 2
2026-03-28 21:06:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6806f8b8-6ac5-58b3-b15b-9a2eee500b2c, identifier: NL55256
2026-03-28 21:06:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6806f8b8-6ac5-58b3-b15b-9a2eee500b2c with identifier: NL55256
2026-03-28 21:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6806f8b8-6ac5-58b3-b15b-9a2eee500b2c with identifier: NL55256
2026-03-28 21:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6806f8b8-6ac5-58b3-b15b-9a2eee500b2c with identifier: NL55256 to the API
2026-03-28 21:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:51:27Z',
'fuel_type': 'petrol',
'id': '6806f8b8-6ac5-58b3-b15b-9a2eee500b2c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL55256',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira Tourer',
'odometer': 255490,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-29',
'seller_name': None,
'title': 'Opel Zafira Tourer 1.6 Turbo Cosmo',
'transmission': 'manual',
'trim': 'Cosmo',
'year': 2014}
2026-03-28 21:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL55256%27 HTTP/1.1" 200 None
2026-03-28 21:06:03 [auto1.it] INFO: Saving data for NL55256: {'auction_closing_time': 1774885887.0, 'created_time': 1772309030.354986, 'last_price_update_time': 1774731963.323876}
2026-03-28 21:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NL55256') HTTP/1.1" 204 0
2026-03-28 21:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:03 [auto1.it] INFO: Found listing with ID: VN35608
2026-03-28 21:06:03 [auto1.it] INFO: Found listing with ID: LC36038
2026-03-28 21:06:03 [auto1.it] INFO: Found listing with ID: UF75242
2026-03-28 21:06:03 [auto1.it] INFO: Found listing with ID: EC29909
2026-03-28 21:06:03 [auto1.it] INFO: Found listing with ID: PE07911
2026-03-28 21:06:03 [auto1.it] INFO: Found listing with ID: XD70855
2026-03-28 21:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD70855%27 HTTP/1.1" 200 None
2026-03-28 21:06:03 [auto1.it] INFO: Scrape type for XD70855: 0
2026-03-28 21:06:03 [auto1.it] INFO: Found listing with ID: JW87652
2026-03-28 21:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JW87652%27 HTTP/1.1" 200 None
2026-03-28 21:06:03 [auto1.it] INFO: Scrape type for JW87652: 0
2026-03-28 21:06:03 [auto1.it] INFO: Found listing with ID: NC90447
2026-03-28 21:06:03 [auto1.it] INFO: Found listing with ID: RF52556
2026-03-28 21:06:03 [auto1.it] INFO: Found listing with ID: KC88615
2026-03-28 21:06:03 [auto1.it] INFO: Found listing with ID: GC55004
2026-03-28 21:06:03 [auto1.it] INFO: Found listing with ID: TV99764
2026-03-28 21:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV99764%27 HTTP/1.1" 200 None
2026-03-28 21:06:03 [auto1.it] INFO: Scrape type for TV99764: 0
2026-03-28 21:06:03 [auto1.it] INFO: Found listing with ID: ZG57893
2026-03-28 21:06:03 [auto1.it] INFO: Found listing with ID: YG18020
2026-03-28 21:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG18020%27 HTTP/1.1" 200 None
2026-03-28 21:06:03 [auto1.it] INFO: Scrape type for YG18020: 0
2026-03-28 21:06:03 [auto1.it] INFO: Found listing with ID: WH55866
2026-03-28 21:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH55866%27 HTTP/1.1" 200 None
2026-03-28 21:06:03 [auto1.it] INFO: Scrape type for WH55866: 0
2026-03-28 21:06:03 [auto1.it] INFO: Found listing with ID: HD54235
2026-03-28 21:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD54235%27 HTTP/1.1" 200 None
2026-03-28 21:06:03 [auto1.it] INFO: Scrape type for HD54235: 0
2026-03-28 21:06:03 [auto1.it] INFO: Found listing with ID: FD29696
2026-03-28 21:06:03 [auto1.it] INFO: Found listing with ID: GT76958
2026-03-28 21:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT76958%27 HTTP/1.1" 200 None
2026-03-28 21:06:03 [auto1.it] INFO: Scrape type for GT76958: 0
2026-03-28 21:06:03 [auto1.it] INFO: Found listing with ID: EZ73351
2026-03-28 21:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NW47878/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:04 [auto1.it] INFO: Channel: 24h | Page: 13 | totalHits: 2224 | hits on page: 40
2026-03-28 21:06:04 [auto1.it] INFO: Found listing with ID: NH73732
2026-03-28 21:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH73732%27 HTTP/1.1" 200 None
2026-03-28 21:06:04 [auto1.it] INFO: Scrape type for NH73732: 0
2026-03-28 21:06:04 [auto1.it] INFO: Found listing with ID: EZ12960
2026-03-28 21:06:04 [auto1.it] INFO: Found listing with ID: PM88021
2026-03-28 21:06:04 [auto1.it] INFO: Found listing with ID: GT16338
2026-03-28 21:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT16338%27 HTTP/1.1" 200 None
2026-03-28 21:06:04 [auto1.it] INFO: Scrape type for GT16338: 0
2026-03-28 21:06:04 [auto1.it] INFO: Found listing with ID: WZ40427
2026-03-28 21:06:04 [auto1.it] INFO: Found listing with ID: WV44347
2026-03-28 21:06:04 [auto1.it] INFO: Found listing with ID: FH81414
2026-03-28 21:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FH81414%27 HTTP/1.1" 200 None
2026-03-28 21:06:04 [auto1.it] INFO: Scrape type for FH81414: 0
2026-03-28 21:06:04 [auto1.it] INFO: Found listing with ID: AP78180
2026-03-28 21:06:04 [auto1.it] INFO: Found listing with ID: NM56587
2026-03-28 21:06:04 [auto1.it] INFO: Found listing with ID: RC69852
2026-03-28 21:06:04 [auto1.it] INFO: Found listing with ID: XB17509
2026-03-28 21:06:04 [auto1.it] INFO: Found listing with ID: DW69714
2026-03-28 21:06:04 [auto1.it] INFO: Found listing with ID: JC86695
2026-03-28 21:06:04 [auto1.it] INFO: Found listing with ID: DS58810
2026-03-28 21:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS58810%27 HTTP/1.1" 200 None
2026-03-28 21:06:04 [auto1.it] INFO: Scrape type for DS58810: 0
2026-03-28 21:06:04 [auto1.it] INFO: Found listing with ID: SE79185
2026-03-28 21:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SE79185%27 HTTP/1.1" 200 None
2026-03-28 21:06:04 [auto1.it] INFO: Scrape type for SE79185: 0
2026-03-28 21:06:04 [auto1.it] INFO: Found listing with ID: HN90303
2026-03-28 21:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HN90303%27 HTTP/1.1" 200 None
2026-03-28 21:06:04 [auto1.it] INFO: Scrape type for HN90303: 1
2026-03-28 21:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:04 [auto1.it] INFO: Found listing with ID: PD12623
2026-03-28 21:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD12623%27 HTTP/1.1" 200 None
2026-03-28 21:06:04 [auto1.it] INFO: Scrape type for PD12623: 0
2026-03-28 21:06:04 [auto1.it] INFO: Found listing with ID: GT17675
2026-03-28 21:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT17675%27 HTTP/1.1" 200 None
2026-03-28 21:06:04 [auto1.it] INFO: Scrape type for GT17675: 0
2026-03-28 21:06:04 [auto1.it] INFO: Found listing with ID: JT48153
2026-03-28 21:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT48153%27 HTTP/1.1" 200 None
2026-03-28 21:06:04 [auto1.it] INFO: Scrape type for JT48153: 0
2026-03-28 21:06:04 [auto1.it] INFO: Found listing with ID: KT77401
2026-03-28 21:06:04 [auto1.it] INFO: Found listing with ID: UC06691
2026-03-28 21:06:04 [auto1.it] INFO: Found listing with ID: FZ12921
2026-03-28 21:06:04 [auto1.it] INFO: Found listing with ID: ED34625
2026-03-28 21:06:04 [auto1.it] INFO: Found listing with ID: JN59652
2026-03-28 21:06:04 [auto1.it] INFO: Found listing with ID: JB83291
2026-03-28 21:06:04 [auto1.it] INFO: Found listing with ID: TL40655
2026-03-28 21:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL40655%27 HTTP/1.1" 200 None
2026-03-28 21:06:04 [auto1.it] INFO: Scrape type for TL40655: 0
2026-03-28 21:06:04 [auto1.it] INFO: Found listing with ID: LG12773
2026-03-28 21:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG12773%27 HTTP/1.1" 200 None
2026-03-28 21:06:04 [auto1.it] INFO: Scrape type for LG12773: 2
2026-03-28 21:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91f06702-0c06-555a-b736-f5f9ba440610 with identifier: LG12773
2026-03-28 21:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91f06702-0c06-555a-b736-f5f9ba440610 with scrape type 2
2026-03-28 21:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91f06702-0c06-555a-b736-f5f9ba440610 with scrape type 2
2026-03-28 21:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 91f06702-0c06-555a-b736-f5f9ba440610, identifier: LG12773
2026-03-28 21:06:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 91f06702-0c06-555a-b736-f5f9ba440610 with identifier: LG12773
2026-03-28 21:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 91f06702-0c06-555a-b736-f5f9ba440610 with identifier: LG12773
2026-03-28 21:06:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 91f06702-0c06-555a-b736-f5f9ba440610 with identifier: LG12773 to the API
2026-03-28 21:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:51:56Z',
'fuel_type': 'diesel',
'id': '91f06702-0c06-555a-b736-f5f9ba440610',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG12773',
'listing': 'auction',
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 167141,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-26',
'seller_name': None,
'title': 'Audi A5 Sportback 40 TDI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2019}
2026-03-28 21:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG12773%27 HTTP/1.1" 200 None
2026-03-28 21:06:04 [auto1.it] INFO: Saving data for LG12773: {'auction_closing_time': 1774885916.0, 'created_time': 1774533977.05575, 'last_price_update_time': 1774731964.956922}
2026-03-28 21:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LG12773') HTTP/1.1" 204 0
2026-03-28 21:06:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:05 [auto1.it] INFO: Found listing with ID: KZ84746
2026-03-28 21:06:05 [auto1.it] INFO: Found listing with ID: FT05147
2026-03-28 21:06:05 [auto1.it] INFO: Found listing with ID: ST64226
2026-03-28 21:06:05 [auto1.it] INFO: Found listing with ID: LE96160
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE96160%27 HTTP/1.1" 200 None
2026-03-28 21:06:05 [auto1.it] INFO: Scrape type for LE96160: 0
2026-03-28 21:06:05 [auto1.it] INFO: Found listing with ID: SV71044
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV71044%27 HTTP/1.1" 200 None
2026-03-28 21:06:05 [auto1.it] INFO: Scrape type for SV71044: 0
2026-03-28 21:06:05 [auto1.it] INFO: Found listing with ID: ZW92714
2026-03-28 21:06:05 [auto1.it] INFO: Found listing with ID: XL03216
2026-03-28 21:06:05 [auto1.it] INFO: Found listing with ID: DR27432
2026-03-28 21:06:05 [auto1.it] INFO: Found listing with ID: HS22715
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS22715%27 HTTP/1.1" 200 None
2026-03-28 21:06:05 [auto1.it] INFO: Scrape type for HS22715: 0
2026-03-28 21:06:05 [auto1.it] INFO: Found listing with ID: SC05419
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC05419%27 HTTP/1.1" 200 None
2026-03-28 21:06:05 [auto1.it] INFO: Scrape type for SC05419: 0
2026-03-28 21:06:05 [auto1.it] INFO: Found listing with ID: GL53946
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL53946%27 HTTP/1.1" 200 None
2026-03-28 21:06:05 [auto1.it] INFO: Scrape type for GL53946: 0
2026-03-28 21:06:05 [auto1.it] INFO: Found listing with ID: TC64761
2026-03-28 21:06:05 [auto1.it] INFO: Found listing with ID: UC13059
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC13059%27 HTTP/1.1" 200 None
2026-03-28 21:06:05 [auto1.it] INFO: Scrape type for UC13059: 0
2026-03-28 21:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NW47878> (referer: https://www.auto1.com/v1/car-details-view/NW47878/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XE77432> (referer: https://www.auto1.com/v1/car-details-view/XE77432/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:05 [scrapy.extensions.logstats] INFO: Crawled 67 pages (at 67 pages/min), scraped 44 items (at 44 items/min)
2026-03-28 21:06:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 166MiB
2026-03-28 21:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63273f98-6a78-5346-bdd9-433b8f83a093 with identifier: NW47878
2026-03-28 21:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63273f98-6a78-5346-bdd9-433b8f83a093 with scrape type 1
2026-03-28 21:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 63273f98-6a78-5346-bdd9-433b8f83a093
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fc5%252F36c54c4550b20a5498793ba31e076704%252Fpa%252FNW47878_62ad68e31d8f80b632855d3598b40622.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_62ad68e31d8f80b632855d3598b40622.jpg already downloaded
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fc5%252F36c54c4550b20a5498793ba31e076704%252Fpa%252FNW47878_b618ea2afbe346cab23785e886cb01bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_b618ea2afbe346cab23785e886cb01bb.jpg already downloaded
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fc5%252F36c54c4550b20a5498793ba31e076704%252Fpa%252FNW47878_d83bfbbfca40e7fe61c8f7284696b68e.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_d83bfbbfca40e7fe61c8f7284696b68e.jpg already downloaded
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fc5%252F36c54c4550b20a5498793ba31e076704%252Fpa%252FNW47878_47e2ffa19b4639c270e7e520a27a86c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_47e2ffa19b4639c270e7e520a27a86c5.jpg already downloaded
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fc5%252F36c54c4550b20a5498793ba31e076704%252Fpa%252FNW47878_6202e14851f33d3b316b8466869179ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_6202e14851f33d3b316b8466869179ca.jpg already downloaded
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fc5%252F36c54c4550b20a5498793ba31e076704%252Fpa%252FNW47878_8ef8816a7563f211b466809de651bf56.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_8ef8816a7563f211b466809de651bf56.jpg already downloaded
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fc5%252F36c54c4550b20a5498793ba31e076704%252Fpa%252FNW47878_7e40a99d3bb4ec2fe0fa91101bb70b6c.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_7e40a99d3bb4ec2fe0fa91101bb70b6c.jpg already downloaded
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fc5%252F36c54c4550b20a5498793ba31e076704%252Fpa%252FNW47878_aa0906ab2e48cde736c54d69c58ecc6c.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_aa0906ab2e48cde736c54d69c58ecc6c.jpg already downloaded
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fc5%252F36c54c4550b20a5498793ba31e076704%252Fpa%252FNW47878_f653fa014b1e9900eff61c69b514e306.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_f653fa014b1e9900eff61c69b514e306.jpg already downloaded
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fc5%252F36c54c4550b20a5498793ba31e076704%252Fpa%252FNW47878_e587f5bd68b05bf3f9a9f968dd07a437.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_e587f5bd68b05bf3f9a9f968dd07a437.jpg already downloaded
2026-03-28 21:06:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 63273f98-6a78-5346-bdd9-433b8f83a093, identifier: NW47878
2026-03-28 21:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d95887c-c491-513c-a8d7-7a97147ee6c4 with identifier: XE77432
2026-03-28 21:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d95887c-c491-513c-a8d7-7a97147ee6c4 with scrape type 1
2026-03-28 21:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3d95887c-c491-513c-a8d7-7a97147ee6c4
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F46%252Fdf468278df7103f36019e41f14c1fb32%252Fpa%252FXE77432_2842081c579910644d80e7756d90dc40.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_2842081c579910644d80e7756d90dc40.jpg already downloaded
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F46%252Fdf468278df7103f36019e41f14c1fb32%252Fpa%252FXE77432_0f6f5c7cc21ec1c8fc26a57bc1c16d2b.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_0f6f5c7cc21ec1c8fc26a57bc1c16d2b.jpg already downloaded
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F46%252Fdf468278df7103f36019e41f14c1fb32%252Fpa%252FXE77432_2ff76f9bb854ffd5c4481eecaa4697a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_2ff76f9bb854ffd5c4481eecaa4697a0.jpg already downloaded
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F46%252Fdf468278df7103f36019e41f14c1fb32%252Fpa%252FXE77432_2baada55099942538c40473081ef9d20.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_2baada55099942538c40473081ef9d20.jpg already downloaded
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F46%252Fdf468278df7103f36019e41f14c1fb32%252Fpa%252FXE77432_f5188c85beed392cf6a8e2a082d428fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_f5188c85beed392cf6a8e2a082d428fd.jpg already downloaded
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F46%252Fdf468278df7103f36019e41f14c1fb32%252Fpa%252FXE77432_e613cb8543be13acf84863f43d06233a.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_e613cb8543be13acf84863f43d06233a.jpg already downloaded
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F46%252Fdf468278df7103f36019e41f14c1fb32%252Fpa%252FXE77432_423145ca1d04dc5f1ff91fb4abb4dd12.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_423145ca1d04dc5f1ff91fb4abb4dd12.jpg already downloaded
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F46%252Fdf468278df7103f36019e41f14c1fb32%252Fpa%252FXE77432_33d1d0d1dc39c690c68323c8eed96a48.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_33d1d0d1dc39c690c68323c8eed96a48.jpg already downloaded
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F46%252Fdf468278df7103f36019e41f14c1fb32%252Fpa%252FXE77432_167401d0cdd8b6380ff49e3bc82582d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_167401d0cdd8b6380ff49e3bc82582d3.jpg already downloaded
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F46%252Fdf468278df7103f36019e41f14c1fb32%252Fpa%252FXE77432_4f4e877fa572a396b2213563fd4f2ca9.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_4f4e877fa572a396b2213563fd4f2ca9.jpg already downloaded
2026-03-28 21:06:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3d95887c-c491-513c-a8d7-7a97147ee6c4, identifier: XE77432
2026-03-28 21:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 63273f98-6a78-5346-bdd9-433b8f83a093 with identifier: NW47878
2026-03-28 21:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 63273f98-6a78-5346-bdd9-433b8f83a093 with identifier: NW47878
2026-03-28 21:06:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 63273f98-6a78-5346-bdd9-433b8f83a093 with identifier: NW47878 to the API
2026-03-28 21:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NW47878>
{'auction_title': '',
'c_o_2_emission_value': 158,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.4L',
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:13:21Z',
'fuel_type': 'petrol',
'id': '63273f98-6a78-5346-bdd9-433b8f83a093',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW47878',
'listing': 'auction',
'location': 'IT, Milazzo',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 121201,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_62ad68e31d8f80b632855d3598b40622.jpg',
'https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_b618ea2afbe346cab23785e886cb01bb.jpg',
'https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_d83bfbbfca40e7fe61c8f7284696b68e.jpg',
'https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_47e2ffa19b4639c270e7e520a27a86c5.jpg',
'https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_6202e14851f33d3b316b8466869179ca.jpg',
'https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_8ef8816a7563f211b466809de651bf56.jpg',
'https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_7e40a99d3bb4ec2fe0fa91101bb70b6c.jpg',
'https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_aa0906ab2e48cde736c54d69c58ecc6c.jpg',
'https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_f653fa014b1e9900eff61c69b514e306.jpg',
'https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_e587f5bd68b05bf3f9a9f968dd07a437.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63273f98-6a78-5346-bdd9-433b8f83a093/63273f98-6a78-5346-bdd9-433b8f83a093_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89753,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_62ad68e31d8f80b632855d3598b40622.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63273f98-6a78-5346-bdd9-433b8f83a093/63273f98-6a78-5346-bdd9-433b8f83a093_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90916,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_b618ea2afbe346cab23785e886cb01bb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63273f98-6a78-5346-bdd9-433b8f83a093/63273f98-6a78-5346-bdd9-433b8f83a093_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81727,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_d83bfbbfca40e7fe61c8f7284696b68e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63273f98-6a78-5346-bdd9-433b8f83a093/63273f98-6a78-5346-bdd9-433b8f83a093_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70026,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_47e2ffa19b4639c270e7e520a27a86c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63273f98-6a78-5346-bdd9-433b8f83a093/63273f98-6a78-5346-bdd9-433b8f83a093_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87298,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_6202e14851f33d3b316b8466869179ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63273f98-6a78-5346-bdd9-433b8f83a093/63273f98-6a78-5346-bdd9-433b8f83a093_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87357,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_8ef8816a7563f211b466809de651bf56.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63273f98-6a78-5346-bdd9-433b8f83a093/63273f98-6a78-5346-bdd9-433b8f83a093_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83121,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_7e40a99d3bb4ec2fe0fa91101bb70b6c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63273f98-6a78-5346-bdd9-433b8f83a093/63273f98-6a78-5346-bdd9-433b8f83a093_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114218,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_aa0906ab2e48cde736c54d69c58ecc6c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63273f98-6a78-5346-bdd9-433b8f83a093/63273f98-6a78-5346-bdd9-433b8f83a093_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80254,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_f653fa014b1e9900eff61c69b514e306.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63273f98-6a78-5346-bdd9-433b8f83a093/63273f98-6a78-5346-bdd9-433b8f83a093_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77476,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/c5/36c54c4550b20a5498793ba31e076704/pa/NW47878_e587f5bd68b05bf3f9a9f968dd07a437.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2002-09-15',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.4 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2002}
2026-03-28 21:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW47878%27 HTTP/1.1" 200 None
2026-03-28 21:06:06 [auto1.it] INFO: Saving data for NW47878: {'created_time': 1774731966.250323, 'last_price_update_time': 1774731966.250335, 'auction_closing_time': 1774883601.0}
2026-03-28 21:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NW47878') HTTP/1.1" 204 0
2026-03-28 21:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3d95887c-c491-513c-a8d7-7a97147ee6c4 with identifier: XE77432
2026-03-28 21:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3d95887c-c491-513c-a8d7-7a97147ee6c4 with identifier: XE77432
2026-03-28 21:06:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3d95887c-c491-513c-a8d7-7a97147ee6c4 with identifier: XE77432 to the API
2026-03-28 21:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XE77432>
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.3L',
'engine_horse_power': 159,
'expiration_date': '2026-03-30T15:58:00Z',
'fuel_type': 'petrol',
'id': '3d95887c-c491-513c-a8d7-7a97147ee6c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE77432',
'listing': 'auction',
'location': 'IT, Roma',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 210305,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_2842081c579910644d80e7756d90dc40.jpg',
'https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_0f6f5c7cc21ec1c8fc26a57bc1c16d2b.jpg',
'https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_2ff76f9bb854ffd5c4481eecaa4697a0.jpg',
'https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_2baada55099942538c40473081ef9d20.jpg',
'https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_f5188c85beed392cf6a8e2a082d428fd.jpg',
'https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_e613cb8543be13acf84863f43d06233a.jpg',
'https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_423145ca1d04dc5f1ff91fb4abb4dd12.jpg',
'https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_33d1d0d1dc39c690c68323c8eed96a48.jpg',
'https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_167401d0cdd8b6380ff49e3bc82582d3.jpg',
'https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_4f4e877fa572a396b2213563fd4f2ca9.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d95887c-c491-513c-a8d7-7a97147ee6c4/3d95887c-c491-513c-a8d7-7a97147ee6c4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79677,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_2842081c579910644d80e7756d90dc40.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d95887c-c491-513c-a8d7-7a97147ee6c4/3d95887c-c491-513c-a8d7-7a97147ee6c4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2971942,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_0f6f5c7cc21ec1c8fc26a57bc1c16d2b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d95887c-c491-513c-a8d7-7a97147ee6c4/3d95887c-c491-513c-a8d7-7a97147ee6c4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68187,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_2ff76f9bb854ffd5c4481eecaa4697a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d95887c-c491-513c-a8d7-7a97147ee6c4/3d95887c-c491-513c-a8d7-7a97147ee6c4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62031,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_2baada55099942538c40473081ef9d20.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d95887c-c491-513c-a8d7-7a97147ee6c4/3d95887c-c491-513c-a8d7-7a97147ee6c4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63523,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_f5188c85beed392cf6a8e2a082d428fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d95887c-c491-513c-a8d7-7a97147ee6c4/3d95887c-c491-513c-a8d7-7a97147ee6c4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62027,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_e613cb8543be13acf84863f43d06233a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d95887c-c491-513c-a8d7-7a97147ee6c4/3d95887c-c491-513c-a8d7-7a97147ee6c4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55124,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_423145ca1d04dc5f1ff91fb4abb4dd12.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d95887c-c491-513c-a8d7-7a97147ee6c4/3d95887c-c491-513c-a8d7-7a97147ee6c4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62331,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_33d1d0d1dc39c690c68323c8eed96a48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d95887c-c491-513c-a8d7-7a97147ee6c4/3d95887c-c491-513c-a8d7-7a97147ee6c4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71302,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_167401d0cdd8b6380ff49e3bc82582d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d95887c-c491-513c-a8d7-7a97147ee6c4/3d95887c-c491-513c-a8d7-7a97147ee6c4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67827,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdf/46/df468278df7103f36019e41f14c1fb32/pa/XE77432_4f4e877fa572a396b2213563fd4f2ca9.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-06-06',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Kadjar 1.3 TCe Sport Edition 2',
'transmission': 'manual',
'trim': 'Sport Edition 2',
'year': 2019}
2026-03-28 21:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE77432%27 HTTP/1.1" 200 None
2026-03-28 21:06:06 [auto1.it] INFO: Saving data for XE77432: {'created_time': 1774731966.680596, 'last_price_update_time': 1774731966.680608, 'auction_closing_time': 1774886280.0}
2026-03-28 21:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XE77432') HTTP/1.1" 204 0
2026-03-28 21:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:07 [auto1.it] INFO: Channel: 24h | Page: 14 | totalHits: 2224 | hits on page: 40
2026-03-28 21:06:07 [auto1.it] INFO: Found listing with ID: XU52863
2026-03-28 21:06:07 [auto1.it] INFO: Found listing with ID: WB86834
2026-03-28 21:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB86834%27 HTTP/1.1" 200 None
2026-03-28 21:06:07 [auto1.it] INFO: Scrape type for WB86834: 0
2026-03-28 21:06:07 [auto1.it] INFO: Found listing with ID: FF76752
2026-03-28 21:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF76752%27 HTTP/1.1" 200 None
2026-03-28 21:06:07 [auto1.it] INFO: Scrape type for FF76752: 0
2026-03-28 21:06:07 [auto1.it] INFO: Found listing with ID: WU65183
2026-03-28 21:06:07 [auto1.it] INFO: Found listing with ID: HK62879
2026-03-28 21:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK62879%27 HTTP/1.1" 200 None
2026-03-28 21:06:07 [auto1.it] INFO: Scrape type for HK62879: 0
2026-03-28 21:06:07 [auto1.it] INFO: Found listing with ID: PR79135
2026-03-28 21:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR79135%27 HTTP/1.1" 200 None
2026-03-28 21:06:07 [auto1.it] INFO: Scrape type for PR79135: 0
2026-03-28 21:06:07 [auto1.it] INFO: Found listing with ID: GX06628
2026-03-28 21:06:07 [auto1.it] INFO: Found listing with ID: RB72441
2026-03-28 21:06:07 [auto1.it] INFO: Found listing with ID: BR31309
2026-03-28 21:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR31309%27 HTTP/1.1" 200 None
2026-03-28 21:06:07 [auto1.it] INFO: Scrape type for BR31309: 0
2026-03-28 21:06:07 [auto1.it] INFO: Found listing with ID: XW11641
2026-03-28 21:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW11641%27 HTTP/1.1" 200 None
2026-03-28 21:06:07 [auto1.it] INFO: Scrape type for XW11641: 0
2026-03-28 21:06:07 [auto1.it] INFO: Found listing with ID: LR54413
2026-03-28 21:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR54413%27 HTTP/1.1" 200 None
2026-03-28 21:06:07 [auto1.it] INFO: Scrape type for LR54413: 0
2026-03-28 21:06:07 [auto1.it] INFO: Found listing with ID: CD07087
2026-03-28 21:06:07 [auto1.it] INFO: Found listing with ID: UE17288
2026-03-28 21:06:07 [auto1.it] INFO: Found listing with ID: TZ83708
2026-03-28 21:06:07 [auto1.it] INFO: Found listing with ID: FF49180
2026-03-28 21:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF49180%27 HTTP/1.1" 200 None
2026-03-28 21:06:07 [auto1.it] INFO: Scrape type for FF49180: 0
2026-03-28 21:06:07 [auto1.it] INFO: Found listing with ID: CS05902
2026-03-28 21:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS05902%27 HTTP/1.1" 200 None
2026-03-28 21:06:07 [auto1.it] INFO: Scrape type for CS05902: 0
2026-03-28 21:06:07 [auto1.it] INFO: Found listing with ID: VB70261
2026-03-28 21:06:07 [auto1.it] INFO: Found listing with ID: ZV11200
2026-03-28 21:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV11200%27 HTTP/1.1" 200 None
2026-03-28 21:06:07 [auto1.it] INFO: Scrape type for ZV11200: 0
2026-03-28 21:06:07 [auto1.it] INFO: Found listing with ID: DA61571
2026-03-28 21:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA61571%27 HTTP/1.1" 200 None
2026-03-28 21:06:07 [auto1.it] INFO: Scrape type for DA61571: 2
2026-03-28 21:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f472155c-59ff-5e28-8a89-64a5d39b9c60 with identifier: DA61571
2026-03-28 21:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f472155c-59ff-5e28-8a89-64a5d39b9c60 with scrape type 2
2026-03-28 21:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f472155c-59ff-5e28-8a89-64a5d39b9c60 with scrape type 2
2026-03-28 21:06:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f472155c-59ff-5e28-8a89-64a5d39b9c60, identifier: DA61571
2026-03-28 21:06:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f472155c-59ff-5e28-8a89-64a5d39b9c60 with identifier: DA61571
2026-03-28 21:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f472155c-59ff-5e28-8a89-64a5d39b9c60 with identifier: DA61571
2026-03-28 21:06:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f472155c-59ff-5e28-8a89-64a5d39b9c60 with identifier: DA61571 to the API
2026-03-28 21:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:23:26Z',
'fuel_type': 'diesel',
'id': 'f472155c-59ff-5e28-8a89-64a5d39b9c60',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA61571',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 112775,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-24',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Business BlueMotion Tech',
'transmission': 'manual',
'trim': 'Business BlueMotion Tech',
'year': 2017}
2026-03-28 21:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA61571%27 HTTP/1.1" 200 None
2026-03-28 21:06:08 [auto1.it] INFO: Saving data for DA61571: {'auction_closing_time': 1774884206.0, 'created_time': 1774127243.14289, 'last_price_update_time': 1774731968.008653}
2026-03-28 21:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DA61571') HTTP/1.1" 204 0
2026-03-28 21:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:08 [auto1.it] INFO: Found listing with ID: DX02178
2026-03-28 21:06:08 [auto1.it] INFO: Found listing with ID: YG03340
2026-03-28 21:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG03340%27 HTTP/1.1" 200 None
2026-03-28 21:06:08 [auto1.it] INFO: Scrape type for YG03340: 0
2026-03-28 21:06:08 [auto1.it] INFO: Found listing with ID: FF98619
2026-03-28 21:06:08 [auto1.it] INFO: Found listing with ID: YP32890
2026-03-28 21:06:08 [auto1.it] INFO: Found listing with ID: NF96122
2026-03-28 21:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF96122%27 HTTP/1.1" 200 None
2026-03-28 21:06:08 [auto1.it] INFO: Scrape type for NF96122: 0
2026-03-28 21:06:08 [auto1.it] INFO: Found listing with ID: LK74824
2026-03-28 21:06:08 [auto1.it] INFO: Found listing with ID: ZJ55913
2026-03-28 21:06:08 [auto1.it] INFO: Found listing with ID: GN63834
2026-03-28 21:06:08 [auto1.it] INFO: Found listing with ID: VL10175
2026-03-28 21:06:08 [auto1.it] INFO: Found listing with ID: YS71318
2026-03-28 21:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS71318%27 HTTP/1.1" 200 None
2026-03-28 21:06:08 [auto1.it] INFO: Scrape type for YS71318: 0
2026-03-28 21:06:08 [auto1.it] INFO: Found listing with ID: CJ66066
2026-03-28 21:06:08 [auto1.it] INFO: Found listing with ID: UR23669
2026-03-28 21:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR23669%27 HTTP/1.1" 200 None
2026-03-28 21:06:08 [auto1.it] INFO: Scrape type for UR23669: 0
2026-03-28 21:06:08 [auto1.it] INFO: Found listing with ID: DN72005
2026-03-28 21:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN72005%27 HTTP/1.1" 200 None
2026-03-28 21:06:08 [auto1.it] INFO: Scrape type for DN72005: 0
2026-03-28 21:06:08 [auto1.it] INFO: Found listing with ID: FJ79920
2026-03-28 21:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ79920%27 HTTP/1.1" 200 None
2026-03-28 21:06:08 [auto1.it] INFO: Scrape type for FJ79920: 0
2026-03-28 21:06:08 [auto1.it] INFO: Found listing with ID: AP13803
2026-03-28 21:06:08 [auto1.it] INFO: Found listing with ID: DK34642
2026-03-28 21:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK34642%27 HTTP/1.1" 200 None
2026-03-28 21:06:08 [auto1.it] INFO: Scrape type for DK34642: 0
2026-03-28 21:06:08 [auto1.it] INFO: Found listing with ID: BN52557
2026-03-28 21:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN52557%27 HTTP/1.1" 200 None
2026-03-28 21:06:08 [auto1.it] INFO: Scrape type for BN52557: 0
2026-03-28 21:06:08 [auto1.it] INFO: Found listing with ID: CF78450
2026-03-28 21:06:08 [auto1.it] INFO: Found listing with ID: CM00839
2026-03-28 21:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM00839%27 HTTP/1.1" 200 None
2026-03-28 21:06:08 [auto1.it] INFO: Scrape type for CM00839: 0
2026-03-28 21:06:08 [auto1.it] INFO: Found listing with ID: TV74767
2026-03-28 21:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV74767%27 HTTP/1.1" 200 None
2026-03-28 21:06:08 [auto1.it] INFO: Scrape type for TV74767: 0
2026-03-28 21:06:08 [auto1.it] INFO: Found listing with ID: KA06591
2026-03-28 21:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:09 [auto1.it] INFO: Channel: 24h | Page: 15 | totalHits: 2224 | hits on page: 40
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: LJ91384
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LJ91384%27 HTTP/1.1" 200 None
2026-03-28 21:06:09 [auto1.it] INFO: Scrape type for LJ91384: 0
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: ZA06304
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: XC85106
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC85106%27 HTTP/1.1" 200 None
2026-03-28 21:06:09 [auto1.it] INFO: Scrape type for XC85106: 0
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: FL80694
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: YR53882
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: FL90232
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL90232%27 HTTP/1.1" 200 None
2026-03-28 21:06:09 [auto1.it] INFO: Scrape type for FL90232: 0
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: KT79218
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: GN74108
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN74108%27 HTTP/1.1" 200 None
2026-03-28 21:06:09 [auto1.it] INFO: Scrape type for GN74108: 0
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: TT97007
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT97007%27 HTTP/1.1" 200 None
2026-03-28 21:06:09 [auto1.it] INFO: Scrape type for TT97007: 0
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: CP26264
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP26264%27 HTTP/1.1" 200 None
2026-03-28 21:06:09 [auto1.it] INFO: Scrape type for CP26264: 0
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: DP39396
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: NC00198
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: AG54549
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG54549%27 HTTP/1.1" 200 None
2026-03-28 21:06:09 [auto1.it] INFO: Scrape type for AG54549: 0
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: HY77897
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: BW24813
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW24813%27 HTTP/1.1" 200 None
2026-03-28 21:06:09 [auto1.it] INFO: Scrape type for BW24813: 0
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: UX44191
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UX44191%27 HTTP/1.1" 200 None
2026-03-28 21:06:09 [auto1.it] INFO: Scrape type for UX44191: 0
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: BW34835
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: JF07503
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF07503%27 HTTP/1.1" 200 None
2026-03-28 21:06:09 [auto1.it] INFO: Scrape type for JF07503: 0
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: UC47461
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: HS75117
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: NC89315
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: EM22547
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: AJ89778
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: FR80508
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR80508%27 HTTP/1.1" 200 None
2026-03-28 21:06:09 [auto1.it] INFO: Scrape type for FR80508: 0
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: YP04797
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP04797%27 HTTP/1.1" 200 None
2026-03-28 21:06:09 [auto1.it] INFO: Scrape type for YP04797: 0
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: DM32670
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: UN42756
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: PN03774
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: UN16063
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN16063%27 HTTP/1.1" 200 None
2026-03-28 21:06:09 [auto1.it] INFO: Scrape type for UN16063: 0
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: SJ00829
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: NH03785
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: MS47082
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: RM97748
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM97748%27 HTTP/1.1" 200 None
2026-03-28 21:06:09 [auto1.it] INFO: Scrape type for RM97748: 0
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: CV79259
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: SM10455
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: LH97251
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH97251%27 HTTP/1.1" 200 None
2026-03-28 21:06:09 [auto1.it] INFO: Scrape type for LH97251: 0
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: RJ82738
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ82738%27 HTTP/1.1" 200 None
2026-03-28 21:06:09 [auto1.it] INFO: Scrape type for RJ82738: 0
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: JX68223
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: KH49254
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KH49254%27 HTTP/1.1" 200 None
2026-03-28 21:06:09 [auto1.it] INFO: Scrape type for KH49254: 0
2026-03-28 21:06:09 [auto1.it] INFO: Found listing with ID: TT50547
2026-03-28 21:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HN90303/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:10 [auto1.it] INFO: Channel: 24h | Page: 16 | totalHits: 2224 | hits on page: 40
2026-03-28 21:06:10 [auto1.it] INFO: Found listing with ID: JV05910
2026-03-28 21:06:10 [auto1.it] INFO: Found listing with ID: MA17223
2026-03-28 21:06:10 [auto1.it] INFO: Found listing with ID: PV94920
2026-03-28 21:06:10 [auto1.it] INFO: Found listing with ID: PC08204
2026-03-28 21:06:10 [auto1.it] INFO: Found listing with ID: ZW61080
2026-03-28 21:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW61080%27 HTTP/1.1" 200 None
2026-03-28 21:06:10 [auto1.it] INFO: Scrape type for ZW61080: 0
2026-03-28 21:06:10 [auto1.it] INFO: Found listing with ID: DK51991
2026-03-28 21:06:10 [auto1.it] INFO: Found listing with ID: GG10303
2026-03-28 21:06:10 [auto1.it] INFO: Found listing with ID: SY54924
2026-03-28 21:06:10 [auto1.it] INFO: Found listing with ID: GW48563
2026-03-28 21:06:10 [auto1.it] INFO: Found listing with ID: YE38738
2026-03-28 21:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE38738%27 HTTP/1.1" 200 None
2026-03-28 21:06:10 [auto1.it] INFO: Scrape type for YE38738: 2
2026-03-28 21:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 254f3a47-f6e5-5fb1-a858-a544b56f7983 with identifier: YE38738
2026-03-28 21:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 254f3a47-f6e5-5fb1-a858-a544b56f7983 with scrape type 2
2026-03-28 21:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 254f3a47-f6e5-5fb1-a858-a544b56f7983 with scrape type 2
2026-03-28 21:06:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 254f3a47-f6e5-5fb1-a858-a544b56f7983, identifier: YE38738
2026-03-28 21:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 254f3a47-f6e5-5fb1-a858-a544b56f7983 with identifier: YE38738
2026-03-28 21:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 21:06:11 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-28 21:06:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 21:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 21:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 254f3a47-f6e5-5fb1-a858-a544b56f7983 with identifier: YE38738
2026-03-28 21:06:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 254f3a47-f6e5-5fb1-a858-a544b56f7983 with identifier: YE38738 to the API
2026-03-28 21:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:04:03Z',
'fuel_type': 'petrol',
'id': '254f3a47-f6e5-5fb1-a858-a544b56f7983',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE38738',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 121301,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-07-29',
'seller_name': None,
'title': 'Fiat 500 1.2 Pop',
'transmission': 'manual',
'trim': 'Pop',
'year': 2008}
2026-03-28 21:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE38738%27 HTTP/1.1" 200 None
2026-03-28 21:06:11 [auto1.it] INFO: Saving data for YE38738: {'auction_closing_time': 1774883043.0, 'created_time': 1772309261.607737, 'last_price_update_time': 1774731971.470849}
2026-03-28 21:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YE38738') HTTP/1.1" 204 0
2026-03-28 21:06:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:11 [auto1.it] INFO: Found listing with ID: RN44276
2026-03-28 21:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN44276%27 HTTP/1.1" 200 None
2026-03-28 21:06:11 [auto1.it] INFO: Scrape type for RN44276: 0
2026-03-28 21:06:11 [auto1.it] INFO: Found listing with ID: JC71555
2026-03-28 21:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC71555%27 HTTP/1.1" 200 None
2026-03-28 21:06:11 [auto1.it] INFO: Scrape type for JC71555: 0
2026-03-28 21:06:11 [auto1.it] INFO: Found listing with ID: AN07116
2026-03-28 21:06:11 [auto1.it] INFO: Found listing with ID: LH59018
2026-03-28 21:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH59018%27 HTTP/1.1" 200 None
2026-03-28 21:06:11 [auto1.it] INFO: Scrape type for LH59018: 0
2026-03-28 21:06:11 [auto1.it] INFO: Found listing with ID: NF80846
2026-03-28 21:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF80846%27 HTTP/1.1" 200 None
2026-03-28 21:06:11 [auto1.it] INFO: Scrape type for NF80846: 0
2026-03-28 21:06:11 [auto1.it] INFO: Found listing with ID: XG00486
2026-03-28 21:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XG00486%27 HTTP/1.1" 200 None
2026-03-28 21:06:11 [auto1.it] INFO: Scrape type for XG00486: 0
2026-03-28 21:06:11 [auto1.it] INFO: Found listing with ID: SG75657
2026-03-28 21:06:11 [auto1.it] INFO: Found listing with ID: UK64691
2026-03-28 21:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK64691%27 HTTP/1.1" 200 None
2026-03-28 21:06:11 [auto1.it] INFO: Scrape type for UK64691: 2
2026-03-28 21:06:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47b2fb4a-3188-574f-ae5e-41ed81aa052d with identifier: UK64691
2026-03-28 21:06:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47b2fb4a-3188-574f-ae5e-41ed81aa052d with scrape type 2
2026-03-28 21:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47b2fb4a-3188-574f-ae5e-41ed81aa052d with scrape type 2
2026-03-28 21:06:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 47b2fb4a-3188-574f-ae5e-41ed81aa052d, identifier: UK64691
2026-03-28 21:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 47b2fb4a-3188-574f-ae5e-41ed81aa052d with identifier: UK64691
2026-03-28 21:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 47b2fb4a-3188-574f-ae5e-41ed81aa052d with identifier: UK64691
2026-03-28 21:06:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 47b2fb4a-3188-574f-ae5e-41ed81aa052d with identifier: UK64691 to the API
2026-03-28 21:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:56:42Z',
'fuel_type': 'hybrid',
'id': '47b2fb4a-3188-574f-ae5e-41ed81aa052d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK64691',
'listing': 'auction',
'make': 'Jeep',
'model': 'Compass',
'odometer': 129947,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-29',
'seller_name': None,
'title': 'Jeep Compass 1.3 T4 4xe Plug-in Hybrid 80th Anniversary',
'transmission': 'automatic',
'trim': '80th Anniversary',
'year': 2022}
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK64691%27 HTTP/1.1" 200 None
2026-03-28 21:06:12 [auto1.it] INFO: Saving data for UK64691: {'auction_closing_time': 1774886202.0, 'created_time': 1774645540.656163, 'last_price_update_time': 1774731972.160341}
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UK64691') HTTP/1.1" 204 0
2026-03-28 21:06:12 [auto1.it] INFO: Found listing with ID: XW75946
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW75946%27 HTTP/1.1" 200 None
2026-03-28 21:06:12 [auto1.it] INFO: Scrape type for XW75946: 0
2026-03-28 21:06:12 [auto1.it] INFO: Found listing with ID: SF23261
2026-03-28 21:06:12 [auto1.it] INFO: Found listing with ID: SN49105
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN49105%27 HTTP/1.1" 200 None
2026-03-28 21:06:12 [auto1.it] INFO: Scrape type for SN49105: 2
2026-03-28 21:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e5da254-7ad0-5a5b-bd32-09413490a9b4 with identifier: SN49105
2026-03-28 21:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e5da254-7ad0-5a5b-bd32-09413490a9b4 with scrape type 2
2026-03-28 21:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e5da254-7ad0-5a5b-bd32-09413490a9b4 with scrape type 2
2026-03-28 21:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3e5da254-7ad0-5a5b-bd32-09413490a9b4, identifier: SN49105
2026-03-28 21:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HN90303> (referer: https://www.auto1.com/v1/car-details-view/HN90303/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3e5da254-7ad0-5a5b-bd32-09413490a9b4 with identifier: SN49105
2026-03-28 21:06:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3e5da254-7ad0-5a5b-bd32-09413490a9b4 with identifier: SN49105
2026-03-28 21:06:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3e5da254-7ad0-5a5b-bd32-09413490a9b4 with identifier: SN49105 to the API
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:42:44Z',
'fuel_type': 'diesel',
'id': '3e5da254-7ad0-5a5b-bd32-09413490a9b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN49105',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 278433,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-09-11',
'seller_name': None,
'title': 'Audi A4 2.0 TDI',
'transmission': 'manual',
'trim': '',
'year': 2005}
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN49105%27 HTTP/1.1" 200 None
2026-03-28 21:06:12 [auto1.it] INFO: Saving data for SN49105: {'auction_closing_time': 1774885364.0, 'created_time': 1774534015.85657, 'last_price_update_time': 1774731972.582652}
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SN49105') HTTP/1.1" 204 0
2026-03-28 21:06:12 [auto1.it] INFO: Found listing with ID: SZ00349
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SZ00349%27 HTTP/1.1" 200 None
2026-03-28 21:06:12 [auto1.it] INFO: Scrape type for SZ00349: 0
2026-03-28 21:06:12 [auto1.it] INFO: Found listing with ID: UH39950
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH39950%27 HTTP/1.1" 200 None
2026-03-28 21:06:12 [auto1.it] INFO: Scrape type for UH39950: 0
2026-03-28 21:06:12 [auto1.it] INFO: Found listing with ID: MA83267
2026-03-28 21:06:12 [auto1.it] INFO: Found listing with ID: EU38381
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU38381%27 HTTP/1.1" 200 None
2026-03-28 21:06:12 [auto1.it] INFO: Scrape type for EU38381: 0
2026-03-28 21:06:12 [auto1.it] INFO: Found listing with ID: RM88416
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM88416%27 HTTP/1.1" 200 None
2026-03-28 21:06:12 [auto1.it] INFO: Scrape type for RM88416: 0
2026-03-28 21:06:12 [auto1.it] INFO: Found listing with ID: AH42596
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH42596%27 HTTP/1.1" 200 None
2026-03-28 21:06:12 [auto1.it] INFO: Scrape type for AH42596: 0
2026-03-28 21:06:12 [auto1.it] INFO: Found listing with ID: VY08024
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY08024%27 HTTP/1.1" 200 None
2026-03-28 21:06:12 [auto1.it] INFO: Scrape type for VY08024: 0
2026-03-28 21:06:12 [auto1.it] INFO: Found listing with ID: ZX85690
2026-03-28 21:06:12 [auto1.it] INFO: Found listing with ID: WE98269
2026-03-28 21:06:12 [auto1.it] INFO: Found listing with ID: SV89112
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SV89112%27 HTTP/1.1" 200 None
2026-03-28 21:06:12 [auto1.it] INFO: Scrape type for SV89112: 0
2026-03-28 21:06:12 [auto1.it] INFO: Found listing with ID: JA21524
2026-03-28 21:06:12 [auto1.it] INFO: Found listing with ID: PA07928
2026-03-28 21:06:12 [auto1.it] INFO: Found listing with ID: RF58149
2026-03-28 21:06:12 [auto1.it] INFO: Found listing with ID: LW29692
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW29692%27 HTTP/1.1" 200 None
2026-03-28 21:06:12 [auto1.it] INFO: Scrape type for LW29692: 0
2026-03-28 21:06:12 [auto1.it] INFO: Found listing with ID: LY31332
2026-03-28 21:06:12 [auto1.it] INFO: Found listing with ID: BJ69368
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ69368%27 HTTP/1.1" 200 None
2026-03-28 21:06:12 [auto1.it] INFO: Scrape type for BJ69368: 0
2026-03-28 21:06:12 [auto1.it] INFO: Found listing with ID: KP29994
2026-03-28 21:06:12 [auto1.it] INFO: Found listing with ID: XF08656
2026-03-28 21:06:12 [auto1.it] INFO: Found listing with ID: WY54071
2026-03-28 21:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b6492cf-18dc-5840-a930-ee3941b3d74e with identifier: HN90303
2026-03-28 21:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b6492cf-18dc-5840-a930-ee3941b3d74e with scrape type 1
2026-03-28 21:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6b6492cf-18dc-5840-a930-ee3941b3d74e
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F74%252Fa874b7f56aa01a89cffecb053437e99b%252Fpa%252FHN90303_c2b2d12849a07a24f67023e22a7312cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_c2b2d12849a07a24f67023e22a7312cd.jpg already downloaded
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F74%252Fa874b7f56aa01a89cffecb053437e99b%252Fpa%252FHN90303_c962278a81d506b70fac29f2396d3f1d.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_c962278a81d506b70fac29f2396d3f1d.jpg already downloaded
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F74%252Fa874b7f56aa01a89cffecb053437e99b%252Fpa%252FHN90303_6cf81779cb33eaaf26dd202b9e899156.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_6cf81779cb33eaaf26dd202b9e899156.jpg already downloaded
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F74%252Fa874b7f56aa01a89cffecb053437e99b%252Fpa%252FHN90303_a1460bd19e0a515926e3826538f2f505.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_a1460bd19e0a515926e3826538f2f505.jpg already downloaded
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F74%252Fa874b7f56aa01a89cffecb053437e99b%252Fpa%252FHN90303_056d900dcc7e0c16f864db831834ac37.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_056d900dcc7e0c16f864db831834ac37.jpg already downloaded
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F74%252Fa874b7f56aa01a89cffecb053437e99b%252Fpa%252FHN90303_556817f4e7ad78a530d631bdb39a38e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_556817f4e7ad78a530d631bdb39a38e9.jpg already downloaded
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F74%252Fa874b7f56aa01a89cffecb053437e99b%252Fpa%252FHN90303_d0a4fd7c10af73148c871b9211045bc7.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_d0a4fd7c10af73148c871b9211045bc7.jpg already downloaded
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F74%252Fa874b7f56aa01a89cffecb053437e99b%252Fpa%252FHN90303_c9a4abb50ed99d4416729fb3f59ed49c.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_c9a4abb50ed99d4416729fb3f59ed49c.jpg already downloaded
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F74%252Fa874b7f56aa01a89cffecb053437e99b%252Fpa%252FHN90303_8d7779d1126e65e9bfcf7edc88b947b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_8d7779d1126e65e9bfcf7edc88b947b3.jpg already downloaded
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252F74%252Fa874b7f56aa01a89cffecb053437e99b%252Fpa%252FHN90303_62ec553866680811b98444ec07a09339.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_62ec553866680811b98444ec07a09339.jpg already downloaded
2026-03-28 21:06:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6b6492cf-18dc-5840-a930-ee3941b3d74e, identifier: HN90303
2026-03-28 21:06:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6b6492cf-18dc-5840-a930-ee3941b3d74e with identifier: HN90303
2026-03-28 21:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6b6492cf-18dc-5840-a930-ee3941b3d74e with identifier: HN90303
2026-03-28 21:06:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6b6492cf-18dc-5840-a930-ee3941b3d74e with identifier: HN90303 to the API
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HN90303>
{'auction_title': '',
'c_o_2_emission_value': 215,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:11:42Z',
'fuel_type': 'diesel',
'id': '6b6492cf-18dc-5840-a930-ee3941b3d74e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN90303',
'listing': 'auction',
'location': 'IT, Manoppello (PE)',
'make': 'Ford',
'model': 'Transit',
'odometer': 48393,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_c2b2d12849a07a24f67023e22a7312cd.jpg',
'https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_c962278a81d506b70fac29f2396d3f1d.jpg',
'https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_6cf81779cb33eaaf26dd202b9e899156.jpg',
'https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_a1460bd19e0a515926e3826538f2f505.jpg',
'https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_056d900dcc7e0c16f864db831834ac37.jpg',
'https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_556817f4e7ad78a530d631bdb39a38e9.jpg',
'https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_d0a4fd7c10af73148c871b9211045bc7.jpg',
'https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_c9a4abb50ed99d4416729fb3f59ed49c.jpg',
'https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_8d7779d1126e65e9bfcf7edc88b947b3.jpg',
'https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_62ec553866680811b98444ec07a09339.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6492cf-18dc-5840-a930-ee3941b3d74e/6b6492cf-18dc-5840-a930-ee3941b3d74e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74579,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_c2b2d12849a07a24f67023e22a7312cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6492cf-18dc-5840-a930-ee3941b3d74e/6b6492cf-18dc-5840-a930-ee3941b3d74e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75708,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_c962278a81d506b70fac29f2396d3f1d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6492cf-18dc-5840-a930-ee3941b3d74e/6b6492cf-18dc-5840-a930-ee3941b3d74e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55936,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_6cf81779cb33eaaf26dd202b9e899156.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6492cf-18dc-5840-a930-ee3941b3d74e/6b6492cf-18dc-5840-a930-ee3941b3d74e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47085,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_a1460bd19e0a515926e3826538f2f505.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6492cf-18dc-5840-a930-ee3941b3d74e/6b6492cf-18dc-5840-a930-ee3941b3d74e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48193,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_056d900dcc7e0c16f864db831834ac37.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6492cf-18dc-5840-a930-ee3941b3d74e/6b6492cf-18dc-5840-a930-ee3941b3d74e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51521,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_556817f4e7ad78a530d631bdb39a38e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6492cf-18dc-5840-a930-ee3941b3d74e/6b6492cf-18dc-5840-a930-ee3941b3d74e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1837137,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_d0a4fd7c10af73148c871b9211045bc7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6492cf-18dc-5840-a930-ee3941b3d74e/6b6492cf-18dc-5840-a930-ee3941b3d74e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61357,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_c9a4abb50ed99d4416729fb3f59ed49c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6492cf-18dc-5840-a930-ee3941b3d74e/6b6492cf-18dc-5840-a930-ee3941b3d74e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60747,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_8d7779d1126e65e9bfcf7edc88b947b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6492cf-18dc-5840-a930-ee3941b3d74e/6b6492cf-18dc-5840-a930-ee3941b3d74e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67011,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/74/a874b7f56aa01a89cffecb053437e99b/pa/HN90303_62ec553866680811b98444ec07a09339.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-04-25',
'seats_number': 3,
'seller_name': None,
'title': 'Ford Transit 2.0 TDCi 290 L2 Trend',
'transmission': 'manual',
'trim': '290 L2 Trend',
'year': 2022}
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HN90303%27 HTTP/1.1" 200 None
2026-03-28 21:06:13 [auto1.it] INFO: Saving data for HN90303: {'created_time': 1774731973.527762, 'last_price_update_time': 1774731973.527773, 'auction_closing_time': 1774883502.0}
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HN90303') HTTP/1.1" 204 0
2026-03-28 21:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:13 [auto1.it] INFO: Channel: 24h | Page: 17 | totalHits: 2224 | hits on page: 40
2026-03-28 21:06:13 [auto1.it] INFO: Found listing with ID: CD59978
2026-03-28 21:06:13 [auto1.it] INFO: Found listing with ID: BD54797
2026-03-28 21:06:13 [auto1.it] INFO: Found listing with ID: LX42454
2026-03-28 21:06:13 [auto1.it] INFO: Found listing with ID: TA36833
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA36833%27 HTTP/1.1" 200 None
2026-03-28 21:06:13 [auto1.it] INFO: Scrape type for TA36833: 0
2026-03-28 21:06:13 [auto1.it] INFO: Found listing with ID: ZT44032
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT44032%27 HTTP/1.1" 200 None
2026-03-28 21:06:13 [auto1.it] INFO: Scrape type for ZT44032: 0
2026-03-28 21:06:13 [auto1.it] INFO: Found listing with ID: TD38619
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD38619%27 HTTP/1.1" 200 None
2026-03-28 21:06:13 [auto1.it] INFO: Scrape type for TD38619: 0
2026-03-28 21:06:13 [auto1.it] INFO: Found listing with ID: LN05453
2026-03-28 21:06:13 [auto1.it] INFO: Found listing with ID: GT16147
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT16147%27 HTTP/1.1" 200 None
2026-03-28 21:06:13 [auto1.it] INFO: Scrape type for GT16147: 0
2026-03-28 21:06:13 [auto1.it] INFO: Found listing with ID: VA41104
2026-03-28 21:06:13 [auto1.it] INFO: Found listing with ID: ZT67877
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT67877%27 HTTP/1.1" 200 None
2026-03-28 21:06:13 [auto1.it] INFO: Scrape type for ZT67877: 0
2026-03-28 21:06:13 [auto1.it] INFO: Found listing with ID: ES59878
2026-03-28 21:06:13 [auto1.it] INFO: Found listing with ID: DV09922
2026-03-28 21:06:13 [auto1.it] INFO: Found listing with ID: DJ48929
2026-03-28 21:06:13 [auto1.it] INFO: Found listing with ID: UW92889
2026-03-28 21:06:13 [auto1.it] INFO: Found listing with ID: NJ63404
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NJ63404%27 HTTP/1.1" 200 None
2026-03-28 21:06:13 [auto1.it] INFO: Scrape type for NJ63404: 0
2026-03-28 21:06:13 [auto1.it] INFO: Found listing with ID: HV87754
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HV87754%27 HTTP/1.1" 200 None
2026-03-28 21:06:13 [auto1.it] INFO: Scrape type for HV87754: 2
2026-03-28 21:06:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae2bb114-dbd5-5f75-9cf5-1907a03dfc36 with identifier: HV87754
2026-03-28 21:06:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae2bb114-dbd5-5f75-9cf5-1907a03dfc36 with scrape type 2
2026-03-28 21:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae2bb114-dbd5-5f75-9cf5-1907a03dfc36 with scrape type 2
2026-03-28 21:06:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ae2bb114-dbd5-5f75-9cf5-1907a03dfc36, identifier: HV87754
2026-03-28 21:06:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ae2bb114-dbd5-5f75-9cf5-1907a03dfc36 with identifier: HV87754
2026-03-28 21:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ae2bb114-dbd5-5f75-9cf5-1907a03dfc36 with identifier: HV87754
2026-03-28 21:06:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ae2bb114-dbd5-5f75-9cf5-1907a03dfc36 with identifier: HV87754 to the API
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:03:47Z',
'fuel_type': 'diesel',
'id': 'ae2bb114-dbd5-5f75-9cf5-1907a03dfc36',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV87754',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 156028,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-15',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180 CDI Urban',
'transmission': 'automatic',
'trim': 'Urban',
'year': 2017}
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HV87754%27 HTTP/1.1" 200 None
2026-03-28 21:06:14 [auto1.it] INFO: Saving data for HV87754: {'auction_closing_time': 1774883027.0, 'created_time': 1774533982.693405, 'last_price_update_time': 1774731974.281866}
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HV87754') HTTP/1.1" 204 0
2026-03-28 21:06:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:14 [auto1.it] INFO: Found listing with ID: TV86323
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TV86323%27 HTTP/1.1" 200 None
2026-03-28 21:06:14 [auto1.it] INFO: Scrape type for TV86323: 0
2026-03-28 21:06:14 [auto1.it] INFO: Found listing with ID: TJ75665
2026-03-28 21:06:14 [auto1.it] INFO: Found listing with ID: DM40972
2026-03-28 21:06:14 [auto1.it] INFO: Found listing with ID: TH27811
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH27811%27 HTTP/1.1" 200 None
2026-03-28 21:06:14 [auto1.it] INFO: Scrape type for TH27811: 0
2026-03-28 21:06:14 [auto1.it] INFO: Found listing with ID: TC65145
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TC65145%27 HTTP/1.1" 200 None
2026-03-28 21:06:14 [auto1.it] INFO: Scrape type for TC65145: 0
2026-03-28 21:06:14 [auto1.it] INFO: Found listing with ID: RL48638
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL48638%27 HTTP/1.1" 200 None
2026-03-28 21:06:14 [auto1.it] INFO: Scrape type for RL48638: 0
2026-03-28 21:06:14 [auto1.it] INFO: Found listing with ID: MB12953
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB12953%27 HTTP/1.1" 200 None
2026-03-28 21:06:14 [auto1.it] INFO: Scrape type for MB12953: 0
2026-03-28 21:06:14 [auto1.it] INFO: Found listing with ID: YB75201
2026-03-28 21:06:14 [auto1.it] INFO: Found listing with ID: ZM66429
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM66429%27 HTTP/1.1" 200 None
2026-03-28 21:06:14 [auto1.it] INFO: Scrape type for ZM66429: 0
2026-03-28 21:06:14 [auto1.it] INFO: Found listing with ID: JR93194
2026-03-28 21:06:14 [auto1.it] INFO: Found listing with ID: ZW84587
2026-03-28 21:06:14 [auto1.it] INFO: Found listing with ID: DC70843
2026-03-28 21:06:14 [auto1.it] INFO: Found listing with ID: AL30811
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL30811%27 HTTP/1.1" 200 None
2026-03-28 21:06:14 [auto1.it] INFO: Scrape type for AL30811: 0
2026-03-28 21:06:14 [auto1.it] INFO: Found listing with ID: WU80477
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU80477%27 HTTP/1.1" 200 None
2026-03-28 21:06:14 [auto1.it] INFO: Scrape type for WU80477: 0
2026-03-28 21:06:14 [auto1.it] INFO: Found listing with ID: NF87616
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF87616%27 HTTP/1.1" 200 None
2026-03-28 21:06:14 [auto1.it] INFO: Scrape type for NF87616: 0
2026-03-28 21:06:14 [auto1.it] INFO: Found listing with ID: UT43750
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT43750%27 HTTP/1.1" 200 None
2026-03-28 21:06:14 [auto1.it] INFO: Scrape type for UT43750: 0
2026-03-28 21:06:14 [auto1.it] INFO: Found listing with ID: AF97148
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF97148%27 HTTP/1.1" 200 None
2026-03-28 21:06:14 [auto1.it] INFO: Scrape type for AF97148: 0
2026-03-28 21:06:14 [auto1.it] INFO: Found listing with ID: ZU39445
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU39445%27 HTTP/1.1" 200 None
2026-03-28 21:06:14 [auto1.it] INFO: Scrape type for ZU39445: 0
2026-03-28 21:06:14 [auto1.it] INFO: Found listing with ID: KA22424
2026-03-28 21:06:14 [auto1.it] INFO: Found listing with ID: ZU37783
2026-03-28 21:06:14 [auto1.it] INFO: Found listing with ID: AM53032
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AM53032%27 HTTP/1.1" 200 None
2026-03-28 21:06:14 [auto1.it] INFO: Scrape type for AM53032: 0
2026-03-28 21:06:14 [auto1.it] INFO: Found listing with ID: XF95831
2026-03-28 21:06:14 [auto1.it] INFO: Found listing with ID: GC28590
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC28590%27 HTTP/1.1" 200 None
2026-03-28 21:06:14 [auto1.it] INFO: Scrape type for GC28590: 0
2026-03-28 21:06:14 [auto1.it] INFO: Found listing with ID: WW13816
2026-03-28 21:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:15 [auto1.it] INFO: Channel: 24h | Page: 18 | totalHits: 2224 | hits on page: 40
2026-03-28 21:06:15 [auto1.it] INFO: Found listing with ID: FN78187
2026-03-28 21:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN78187%27 HTTP/1.1" 200 None
2026-03-28 21:06:15 [auto1.it] INFO: Scrape type for FN78187: 0
2026-03-28 21:06:15 [auto1.it] INFO: Found listing with ID: ZV13161
2026-03-28 21:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV13161%27 HTTP/1.1" 200 None
2026-03-28 21:06:15 [auto1.it] INFO: Scrape type for ZV13161: 0
2026-03-28 21:06:15 [auto1.it] INFO: Found listing with ID: CR75802
2026-03-28 21:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR75802%27 HTTP/1.1" 200 None
2026-03-28 21:06:15 [auto1.it] INFO: Scrape type for CR75802: 0
2026-03-28 21:06:15 [auto1.it] INFO: Found listing with ID: GY86444
2026-03-28 21:06:15 [auto1.it] INFO: Found listing with ID: SE74727
2026-03-28 21:06:15 [auto1.it] INFO: Found listing with ID: DC79490
2026-03-28 21:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC79490%27 HTTP/1.1" 200 None
2026-03-28 21:06:15 [auto1.it] INFO: Scrape type for DC79490: 0
2026-03-28 21:06:15 [auto1.it] INFO: Found listing with ID: HJ71706
2026-03-28 21:06:15 [auto1.it] INFO: Found listing with ID: ZW42216
2026-03-28 21:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW42216%27 HTTP/1.1" 200 None
2026-03-28 21:06:15 [auto1.it] INFO: Scrape type for ZW42216: 0
2026-03-28 21:06:15 [auto1.it] INFO: Found listing with ID: WP65731
2026-03-28 21:06:15 [auto1.it] INFO: Found listing with ID: FG66384
2026-03-28 21:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG66384%27 HTTP/1.1" 200 None
2026-03-28 21:06:15 [auto1.it] INFO: Scrape type for FG66384: 0
2026-03-28 21:06:15 [auto1.it] INFO: Found listing with ID: MC91027
2026-03-28 21:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MC91027%27 HTTP/1.1" 200 None
2026-03-28 21:06:15 [auto1.it] INFO: Scrape type for MC91027: 0
2026-03-28 21:06:15 [auto1.it] INFO: Found listing with ID: CN54432
2026-03-28 21:06:15 [auto1.it] INFO: Found listing with ID: DW35808
2026-03-28 21:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW35808%27 HTTP/1.1" 200 None
2026-03-28 21:06:15 [auto1.it] INFO: Scrape type for DW35808: 0
2026-03-28 21:06:15 [auto1.it] INFO: Found listing with ID: NL99769
2026-03-28 21:06:15 [auto1.it] INFO: Found listing with ID: MZ97051
2026-03-28 21:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MZ97051%27 HTTP/1.1" 200 None
2026-03-28 21:06:15 [auto1.it] INFO: Scrape type for MZ97051: 0
2026-03-28 21:06:15 [auto1.it] INFO: Found listing with ID: DW91233
2026-03-28 21:06:15 [auto1.it] INFO: Found listing with ID: RG91775
2026-03-28 21:06:15 [auto1.it] INFO: Found listing with ID: BF95758
2026-03-28 21:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF95758%27 HTTP/1.1" 200 None
2026-03-28 21:06:15 [auto1.it] INFO: Scrape type for BF95758: 0
2026-03-28 21:06:15 [auto1.it] INFO: Found listing with ID: FT00845
2026-03-28 21:06:15 [auto1.it] INFO: Found listing with ID: RG06778
2026-03-28 21:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG06778%27 HTTP/1.1" 200 None
2026-03-28 21:06:15 [auto1.it] INFO: Scrape type for RG06778: 0
2026-03-28 21:06:15 [auto1.it] INFO: Found listing with ID: ZF37954
2026-03-28 21:06:15 [auto1.it] INFO: Found listing with ID: PS40086
2026-03-28 21:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS40086%27 HTTP/1.1" 200 None
2026-03-28 21:06:15 [auto1.it] INFO: Scrape type for PS40086: 0
2026-03-28 21:06:15 [auto1.it] INFO: Found listing with ID: LB35454
2026-03-28 21:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB35454%27 HTTP/1.1" 200 None
2026-03-28 21:06:15 [auto1.it] INFO: Scrape type for LB35454: 2
2026-03-28 21:06:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9fe22a6-d026-58ef-b98f-08460ced78bf with identifier: LB35454
2026-03-28 21:06:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9fe22a6-d026-58ef-b98f-08460ced78bf with scrape type 2
2026-03-28 21:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9fe22a6-d026-58ef-b98f-08460ced78bf with scrape type 2
2026-03-28 21:06:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a9fe22a6-d026-58ef-b98f-08460ced78bf, identifier: LB35454
2026-03-28 21:06:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a9fe22a6-d026-58ef-b98f-08460ced78bf with identifier: LB35454
2026-03-28 21:06:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a9fe22a6-d026-58ef-b98f-08460ced78bf with identifier: LB35454
2026-03-28 21:06:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a9fe22a6-d026-58ef-b98f-08460ced78bf with identifier: LB35454 to the API
2026-03-28 21:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:46:54Z',
'fuel_type': 'petrol',
'id': 'a9fe22a6-d026-58ef-b98f-08460ced78bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB35454',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira Tourer',
'odometer': 167018,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-05',
'seller_name': None,
'title': 'Opel Zafira Tourer 1.4 Turbo Cosmo',
'transmission': 'manual',
'trim': 'Cosmo',
'year': 2016}
2026-03-28 21:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB35454%27 HTTP/1.1" 200 None
2026-03-28 21:06:16 [auto1.it] INFO: Saving data for LB35454: {'auction_closing_time': 1774885614.0, 'created_time': 1774343186.278665, 'last_price_update_time': 1774731976.12086}
2026-03-28 21:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LB35454') HTTP/1.1" 204 0
2026-03-28 21:06:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:16 [auto1.it] INFO: Found listing with ID: XH07717
2026-03-28 21:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH07717%27 HTTP/1.1" 200 None
2026-03-28 21:06:16 [auto1.it] INFO: Scrape type for XH07717: 0
2026-03-28 21:06:16 [auto1.it] INFO: Found listing with ID: XY56734
2026-03-28 21:06:16 [auto1.it] INFO: Found listing with ID: FC72088
2026-03-28 21:06:16 [auto1.it] INFO: Found listing with ID: WK88793
2026-03-28 21:06:16 [auto1.it] INFO: Found listing with ID: HU04780
2026-03-28 21:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU04780%27 HTTP/1.1" 200 None
2026-03-28 21:06:16 [auto1.it] INFO: Scrape type for HU04780: 0
2026-03-28 21:06:16 [auto1.it] INFO: Found listing with ID: UH63202
2026-03-28 21:06:16 [auto1.it] INFO: Found listing with ID: RF41966
2026-03-28 21:06:16 [auto1.it] INFO: Found listing with ID: VY30881
2026-03-28 21:06:16 [auto1.it] INFO: Found listing with ID: JV49964
2026-03-28 21:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV49964%27 HTTP/1.1" 200 None
2026-03-28 21:06:16 [auto1.it] INFO: Scrape type for JV49964: 0
2026-03-28 21:06:16 [auto1.it] INFO: Found listing with ID: HY50336
2026-03-28 21:06:16 [auto1.it] INFO: Found listing with ID: HE58096
2026-03-28 21:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE58096%27 HTTP/1.1" 200 None
2026-03-28 21:06:16 [auto1.it] INFO: Scrape type for HE58096: 0
2026-03-28 21:06:16 [auto1.it] INFO: Found listing with ID: FG41149
2026-03-28 21:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG41149%27 HTTP/1.1" 200 None
2026-03-28 21:06:16 [auto1.it] INFO: Scrape type for FG41149: 0
2026-03-28 21:06:16 [auto1.it] INFO: Found listing with ID: AK04319
2026-03-28 21:06:16 [auto1.it] INFO: Found listing with ID: YM68683
2026-03-28 21:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM68683%27 HTTP/1.1" 200 None
2026-03-28 21:06:16 [auto1.it] INFO: Scrape type for YM68683: 0
2026-03-28 21:06:16 [auto1.it] INFO: Found listing with ID: BR57787
2026-03-28 21:06:16 [auto1.it] INFO: Found listing with ID: EW75020
2026-03-28 21:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW75020%27 HTTP/1.1" 200 None
2026-03-28 21:06:16 [auto1.it] INFO: Scrape type for EW75020: 0
2026-03-28 21:06:16 [auto1.it] INFO: Found listing with ID: BD43330
2026-03-28 21:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD43330%27 HTTP/1.1" 200 None
2026-03-28 21:06:16 [auto1.it] INFO: Scrape type for BD43330: 0
2026-03-28 21:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:18 [auto1.it] INFO: Channel: 24h | Page: 19 | totalHits: 2224 | hits on page: 40
2026-03-28 21:06:18 [auto1.it] INFO: Found listing with ID: JU21728
2026-03-28 21:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU21728%27 HTTP/1.1" 200 None
2026-03-28 21:06:18 [auto1.it] INFO: Scrape type for JU21728: 0
2026-03-28 21:06:18 [auto1.it] INFO: Found listing with ID: SS18980
2026-03-28 21:06:18 [auto1.it] INFO: Found listing with ID: PA42280
2026-03-28 21:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA42280%27 HTTP/1.1" 200 None
2026-03-28 21:06:18 [auto1.it] INFO: Scrape type for PA42280: 0
2026-03-28 21:06:18 [auto1.it] INFO: Found listing with ID: WP88184
2026-03-28 21:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP88184%27 HTTP/1.1" 200 None
2026-03-28 21:06:18 [auto1.it] INFO: Scrape type for WP88184: 0
2026-03-28 21:06:18 [auto1.it] INFO: Found listing with ID: FT22704
2026-03-28 21:06:18 [auto1.it] INFO: Found listing with ID: YS49191
2026-03-28 21:06:18 [auto1.it] INFO: Found listing with ID: CS16004
2026-03-28 21:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS16004%27 HTTP/1.1" 200 None
2026-03-28 21:06:18 [auto1.it] INFO: Scrape type for CS16004: 0
2026-03-28 21:06:18 [auto1.it] INFO: Found listing with ID: LT75746
2026-03-28 21:06:18 [auto1.it] INFO: Found listing with ID: WS24501
2026-03-28 21:06:18 [auto1.it] INFO: Found listing with ID: LY57551
2026-03-28 21:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY57551%27 HTTP/1.1" 200 None
2026-03-28 21:06:18 [auto1.it] INFO: Scrape type for LY57551: 0
2026-03-28 21:06:18 [auto1.it] INFO: Found listing with ID: HA44632
2026-03-28 21:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA44632%27 HTTP/1.1" 200 None
2026-03-28 21:06:18 [auto1.it] INFO: Scrape type for HA44632: 0
2026-03-28 21:06:18 [auto1.it] INFO: Found listing with ID: JS42398
2026-03-28 21:06:18 [auto1.it] INFO: Found listing with ID: EN82101
2026-03-28 21:06:18 [auto1.it] INFO: Found listing with ID: LW40364
2026-03-28 21:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW40364%27 HTTP/1.1" 200 None
2026-03-28 21:06:18 [auto1.it] INFO: Scrape type for LW40364: 0
2026-03-28 21:06:18 [auto1.it] INFO: Found listing with ID: FU42856
2026-03-28 21:06:18 [auto1.it] INFO: Found listing with ID: RB41794
2026-03-28 21:06:18 [auto1.it] INFO: Found listing with ID: HU53243
2026-03-28 21:06:18 [auto1.it] INFO: Found listing with ID: CP99007
2026-03-28 21:06:18 [auto1.it] INFO: Found listing with ID: SH22107
2026-03-28 21:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH22107%27 HTTP/1.1" 200 None
2026-03-28 21:06:18 [auto1.it] INFO: Scrape type for SH22107: 2
2026-03-28 21:06:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de599805-ec7b-5ef1-8bc1-4087b93811eb with identifier: SH22107
2026-03-28 21:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de599805-ec7b-5ef1-8bc1-4087b93811eb with scrape type 2
2026-03-28 21:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de599805-ec7b-5ef1-8bc1-4087b93811eb with scrape type 2
2026-03-28 21:06:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: de599805-ec7b-5ef1-8bc1-4087b93811eb, identifier: SH22107
2026-03-28 21:06:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: de599805-ec7b-5ef1-8bc1-4087b93811eb with identifier: SH22107
2026-03-28 21:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 21:06:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-28 21:06:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 21:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 21:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: de599805-ec7b-5ef1-8bc1-4087b93811eb with identifier: SH22107
2026-03-28 21:06:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: de599805-ec7b-5ef1-8bc1-4087b93811eb with identifier: SH22107 to the API
2026-03-28 21:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'violet',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:50:48Z',
'fuel_type': 'diesel',
'id': 'de599805-ec7b-5ef1-8bc1-4087b93811eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH22107',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 250382,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-26',
'seller_name': None,
'title': 'Hyundai i30 1.6 CRDi Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2013}
2026-03-28 21:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH22107%27 HTTP/1.1" 200 None
2026-03-28 21:06:19 [auto1.it] INFO: Saving data for SH22107: {'auction_closing_time': 1774885848.0, 'created_time': 1772698366.595615, 'last_price_update_time': 1774731979.163296}
2026-03-28 21:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SH22107') HTTP/1.1" 204 0
2026-03-28 21:06:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:19 [auto1.it] INFO: Found listing with ID: SN43721
2026-03-28 21:06:19 [auto1.it] INFO: Found listing with ID: LC07756
2026-03-28 21:06:19 [auto1.it] INFO: Found listing with ID: LG11183
2026-03-28 21:06:19 [auto1.it] INFO: Found listing with ID: NF26556
2026-03-28 21:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF26556%27 HTTP/1.1" 200 None
2026-03-28 21:06:19 [auto1.it] INFO: Scrape type for NF26556: 0
2026-03-28 21:06:19 [auto1.it] INFO: Found listing with ID: SA71650
2026-03-28 21:06:19 [auto1.it] INFO: Found listing with ID: RU03062
2026-03-28 21:06:19 [auto1.it] INFO: Found listing with ID: NZ37386
2026-03-28 21:06:19 [auto1.it] INFO: Found listing with ID: VE23835
2026-03-28 21:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE23835%27 HTTP/1.1" 200 None
2026-03-28 21:06:19 [auto1.it] INFO: Scrape type for VE23835: 0
2026-03-28 21:06:19 [auto1.it] INFO: Found listing with ID: DB18786
2026-03-28 21:06:19 [auto1.it] INFO: Found listing with ID: VC26054
2026-03-28 21:06:19 [auto1.it] INFO: Found listing with ID: ZR59714
2026-03-28 21:06:19 [auto1.it] INFO: Found listing with ID: GV78973
2026-03-28 21:06:19 [auto1.it] INFO: Found listing with ID: US69373
2026-03-28 21:06:19 [auto1.it] INFO: Found listing with ID: RZ15516
2026-03-28 21:06:19 [auto1.it] INFO: Found listing with ID: UZ55357
2026-03-28 21:06:19 [auto1.it] INFO: Found listing with ID: EJ70164
2026-03-28 21:06:19 [auto1.it] INFO: Found listing with ID: DW16027
2026-03-28 21:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW16027%27 HTTP/1.1" 200 None
2026-03-28 21:06:19 [auto1.it] INFO: Scrape type for DW16027: 0
2026-03-28 21:06:19 [auto1.it] INFO: Found listing with ID: EZ15489
2026-03-28 21:06:19 [auto1.it] INFO: Found listing with ID: PZ08956
2026-03-28 21:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ08956%27 HTTP/1.1" 200 None
2026-03-28 21:06:19 [auto1.it] INFO: Scrape type for PZ08956: 0
2026-03-28 21:06:19 [auto1.it] INFO: Found listing with ID: XC90090
2026-03-28 21:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC90090%27 HTTP/1.1" 200 None
2026-03-28 21:06:19 [auto1.it] INFO: Scrape type for XC90090: 0
2026-03-28 21:06:19 [auto1.it] INFO: Found listing with ID: LB78915
2026-03-28 21:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:20 [auto1.it] INFO: Channel: 24h | Page: 20 | totalHits: 2224 | hits on page: 40
2026-03-28 21:06:20 [auto1.it] INFO: Found listing with ID: BV29552
2026-03-28 21:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BV29552%27 HTTP/1.1" 200 None
2026-03-28 21:06:20 [auto1.it] INFO: Scrape type for BV29552: 0
2026-03-28 21:06:20 [auto1.it] INFO: Found listing with ID: DX23883
2026-03-28 21:06:20 [auto1.it] INFO: Found listing with ID: TK94629
2026-03-28 21:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK94629%27 HTTP/1.1" 200 None
2026-03-28 21:06:20 [auto1.it] INFO: Scrape type for TK94629: 0
2026-03-28 21:06:20 [auto1.it] INFO: Found listing with ID: XT45099
2026-03-28 21:06:20 [auto1.it] INFO: Found listing with ID: FM13591
2026-03-28 21:06:20 [auto1.it] INFO: Found listing with ID: VS11522
2026-03-28 21:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS11522%27 HTTP/1.1" 200 None
2026-03-28 21:06:20 [auto1.it] INFO: Scrape type for VS11522: 0
2026-03-28 21:06:20 [auto1.it] INFO: Found listing with ID: YA27066
2026-03-28 21:06:20 [auto1.it] INFO: Found listing with ID: YC82026
2026-03-28 21:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YC82026%27 HTTP/1.1" 200 None
2026-03-28 21:06:20 [auto1.it] INFO: Scrape type for YC82026: 0
2026-03-28 21:06:20 [auto1.it] INFO: Found listing with ID: AM02692
2026-03-28 21:06:20 [auto1.it] INFO: Found listing with ID: TZ10573
2026-03-28 21:06:20 [auto1.it] INFO: Found listing with ID: RJ45303
2026-03-28 21:06:20 [auto1.it] INFO: Found listing with ID: MU47199
2026-03-28 21:06:20 [auto1.it] INFO: Found listing with ID: SL34558
2026-03-28 21:06:20 [auto1.it] INFO: Found listing with ID: BF81880
2026-03-28 21:06:20 [auto1.it] INFO: Found listing with ID: NP01679
2026-03-28 21:06:20 [auto1.it] INFO: Found listing with ID: ZJ24732
2026-03-28 21:06:20 [auto1.it] INFO: Found listing with ID: UK76860
2026-03-28 21:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK76860%27 HTTP/1.1" 200 None
2026-03-28 21:06:20 [auto1.it] INFO: Scrape type for UK76860: 0
2026-03-28 21:06:20 [auto1.it] INFO: Found listing with ID: AY40178
2026-03-28 21:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY40178%27 HTTP/1.1" 200 None
2026-03-28 21:06:20 [auto1.it] INFO: Scrape type for AY40178: 0
2026-03-28 21:06:20 [auto1.it] INFO: Found listing with ID: LA76603
2026-03-28 21:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA76603%27 HTTP/1.1" 200 None
2026-03-28 21:06:20 [auto1.it] INFO: Scrape type for LA76603: 0
2026-03-28 21:06:20 [auto1.it] INFO: Found listing with ID: FY53013
2026-03-28 21:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FY53013%27 HTTP/1.1" 200 None
2026-03-28 21:06:20 [auto1.it] INFO: Scrape type for FY53013: 2
2026-03-28 21:06:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 652acf96-a02e-504a-958a-7c6e4fd54b5c with identifier: FY53013
2026-03-28 21:06:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 652acf96-a02e-504a-958a-7c6e4fd54b5c with scrape type 2
2026-03-28 21:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 652acf96-a02e-504a-958a-7c6e4fd54b5c with scrape type 2
2026-03-28 21:06:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 652acf96-a02e-504a-958a-7c6e4fd54b5c, identifier: FY53013
2026-03-28 21:06:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 652acf96-a02e-504a-958a-7c6e4fd54b5c with identifier: FY53013
2026-03-28 21:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 21:06:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 21:06:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 21:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 21:06:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 652acf96-a02e-504a-958a-7c6e4fd54b5c with identifier: FY53013
2026-03-28 21:06:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 652acf96-a02e-504a-958a-7c6e4fd54b5c with identifier: FY53013 to the API
2026-03-28 21:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:13:59Z',
'fuel_type': 'petrol',
'id': '652acf96-a02e-504a-958a-7c6e4fd54b5c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY53013',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 77488,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-28',
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2014}
2026-03-28 21:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FY53013%27 HTTP/1.1" 200 None
2026-03-28 21:06:21 [auto1.it] INFO: Saving data for FY53013: {'auction_closing_time': 1774883639.0, 'created_time': 1774645558.227105, 'last_price_update_time': 1774731981.15224}
2026-03-28 21:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FY53013') HTTP/1.1" 204 0
2026-03-28 21:06:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:21 [auto1.it] INFO: Found listing with ID: ES67961
2026-03-28 21:06:21 [auto1.it] INFO: Found listing with ID: RD96225
2026-03-28 21:06:21 [auto1.it] INFO: Found listing with ID: WH06276
2026-03-28 21:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH06276%27 HTTP/1.1" 200 None
2026-03-28 21:06:21 [auto1.it] INFO: Scrape type for WH06276: 2
2026-03-28 21:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d8413e3-6e45-5d78-ae03-1f12bc3c7afe with identifier: WH06276
2026-03-28 21:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d8413e3-6e45-5d78-ae03-1f12bc3c7afe with scrape type 2
2026-03-28 21:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d8413e3-6e45-5d78-ae03-1f12bc3c7afe with scrape type 2
2026-03-28 21:06:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2d8413e3-6e45-5d78-ae03-1f12bc3c7afe, identifier: WH06276
2026-03-28 21:06:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2d8413e3-6e45-5d78-ae03-1f12bc3c7afe with identifier: WH06276
2026-03-28 21:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2d8413e3-6e45-5d78-ae03-1f12bc3c7afe with identifier: WH06276
2026-03-28 21:06:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2d8413e3-6e45-5d78-ae03-1f12bc3c7afe with identifier: WH06276 to the API
2026-03-28 21:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:30:50Z',
'fuel_type': 'diesel',
'id': '2d8413e3-6e45-5d78-ae03-1f12bc3c7afe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH06276',
'listing': 'auction',
'make': 'Jeep',
'model': 'Compass',
'odometer': 186046,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-30',
'seller_name': None,
'title': 'Jeep Compass 2.2 CRD Limited 4x4',
'transmission': 'manual',
'trim': 'Limited 4x4',
'year': 2013}
2026-03-28 21:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH06276%27 HTTP/1.1" 200 None
2026-03-28 21:06:21 [auto1.it] INFO: Saving data for WH06276: {'auction_closing_time': 1774884650.0, 'created_time': 1774343161.129443, 'last_price_update_time': 1774731981.687274}
2026-03-28 21:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WH06276') HTTP/1.1" 204 0
2026-03-28 21:06:21 [auto1.it] INFO: Found listing with ID: AH91466
2026-03-28 21:06:21 [auto1.it] INFO: Found listing with ID: JY18899
2026-03-28 21:06:21 [auto1.it] INFO: Found listing with ID: UW72001
2026-03-28 21:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW72001%27 HTTP/1.1" 200 None
2026-03-28 21:06:21 [auto1.it] INFO: Scrape type for UW72001: 2
2026-03-28 21:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d99a3b5-3ff7-53ba-bb9d-913eb205552c with identifier: UW72001
2026-03-28 21:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d99a3b5-3ff7-53ba-bb9d-913eb205552c with scrape type 2
2026-03-28 21:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d99a3b5-3ff7-53ba-bb9d-913eb205552c with scrape type 2
2026-03-28 21:06:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6d99a3b5-3ff7-53ba-bb9d-913eb205552c, identifier: UW72001
2026-03-28 21:06:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6d99a3b5-3ff7-53ba-bb9d-913eb205552c with identifier: UW72001
2026-03-28 21:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6d99a3b5-3ff7-53ba-bb9d-913eb205552c with identifier: UW72001
2026-03-28 21:06:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6d99a3b5-3ff7-53ba-bb9d-913eb205552c with identifier: UW72001 to the API
2026-03-28 21:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:11:33Z',
'fuel_type': 'diesel',
'id': '6d99a3b5-3ff7-53ba-bb9d-913eb205552c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW72001',
'listing': 'auction',
'make': 'Citroen',
'model': 'DS4',
'odometer': 165541,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-29',
'seller_name': None,
'title': 'Citroen DS4 1.6 e-HDi SoChic',
'transmission': 'automatic',
'trim': 'SoChic',
'year': 2014}
2026-03-28 21:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW72001%27 HTTP/1.1" 200 None
2026-03-28 21:06:22 [auto1.it] INFO: Saving data for UW72001: {'auction_closing_time': 1774883493.0, 'created_time': 1774645580.756675, 'last_price_update_time': 1774731982.134789}
2026-03-28 21:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UW72001') HTTP/1.1" 204 0
2026-03-28 21:06:22 [auto1.it] INFO: Found listing with ID: CH37521
2026-03-28 21:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH37521%27 HTTP/1.1" 200 None
2026-03-28 21:06:22 [auto1.it] INFO: Scrape type for CH37521: 0
2026-03-28 21:06:22 [auto1.it] INFO: Found listing with ID: SN82896
2026-03-28 21:06:22 [auto1.it] INFO: Found listing with ID: UM78803
2026-03-28 21:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM78803%27 HTTP/1.1" 200 None
2026-03-28 21:06:22 [auto1.it] INFO: Scrape type for UM78803: 0
2026-03-28 21:06:22 [auto1.it] INFO: Found listing with ID: KR43222
2026-03-28 21:06:22 [auto1.it] INFO: Found listing with ID: LV68988
2026-03-28 21:06:22 [auto1.it] INFO: Found listing with ID: CY31858
2026-03-28 21:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CY31858%27 HTTP/1.1" 200 None
2026-03-28 21:06:22 [auto1.it] INFO: Scrape type for CY31858: 0
2026-03-28 21:06:22 [auto1.it] INFO: Found listing with ID: BR67394
2026-03-28 21:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR67394%27 HTTP/1.1" 200 None
2026-03-28 21:06:22 [auto1.it] INFO: Scrape type for BR67394: 0
2026-03-28 21:06:22 [auto1.it] INFO: Found listing with ID: CD01213
2026-03-28 21:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD01213%27 HTTP/1.1" 200 None
2026-03-28 21:06:22 [auto1.it] INFO: Scrape type for CD01213: 0
2026-03-28 21:06:22 [auto1.it] INFO: Found listing with ID: RD78006
2026-03-28 21:06:22 [auto1.it] INFO: Found listing with ID: SN26450
2026-03-28 21:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN26450%27 HTTP/1.1" 200 None
2026-03-28 21:06:22 [auto1.it] INFO: Scrape type for SN26450: 0
2026-03-28 21:06:22 [auto1.it] INFO: Found listing with ID: MT71865
2026-03-28 21:06:22 [auto1.it] INFO: Found listing with ID: YX83263
2026-03-28 21:06:22 [auto1.it] INFO: Found listing with ID: CP76510
2026-03-28 21:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP76510%27 HTTP/1.1" 200 None
2026-03-28 21:06:22 [auto1.it] INFO: Scrape type for CP76510: 0
2026-03-28 21:06:22 [auto1.it] INFO: Found listing with ID: PZ52577
2026-03-28 21:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ52577%27 HTTP/1.1" 200 None
2026-03-28 21:06:22 [auto1.it] INFO: Scrape type for PZ52577: 0
2026-03-28 21:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:23 [auto1.it] INFO: Channel: 24h | Page: 21 | totalHits: 2224 | hits on page: 40
2026-03-28 21:06:23 [auto1.it] INFO: Found listing with ID: VS54724
2026-03-28 21:06:23 [auto1.it] INFO: Found listing with ID: KH25019
2026-03-28 21:06:23 [auto1.it] INFO: Found listing with ID: PN56075
2026-03-28 21:06:23 [auto1.it] INFO: Found listing with ID: HZ92978
2026-03-28 21:06:23 [auto1.it] INFO: Found listing with ID: VX84045
2026-03-28 21:06:23 [auto1.it] INFO: Found listing with ID: EC20535
2026-03-28 21:06:23 [auto1.it] INFO: Found listing with ID: YJ87795
2026-03-28 21:06:23 [auto1.it] INFO: Found listing with ID: JT68367
2026-03-28 21:06:23 [auto1.it] INFO: Found listing with ID: XZ26785
2026-03-28 21:06:23 [auto1.it] INFO: Found listing with ID: YZ06369
2026-03-28 21:06:23 [auto1.it] INFO: Found listing with ID: CV42265
2026-03-28 21:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV42265%27 HTTP/1.1" 200 None
2026-03-28 21:06:23 [auto1.it] INFO: Scrape type for CV42265: 0
2026-03-28 21:06:23 [auto1.it] INFO: Found listing with ID: RG49415
2026-03-28 21:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG49415%27 HTTP/1.1" 200 None
2026-03-28 21:06:23 [auto1.it] INFO: Scrape type for RG49415: 0
2026-03-28 21:06:23 [auto1.it] INFO: Found listing with ID: ZS94509
2026-03-28 21:06:23 [auto1.it] INFO: Found listing with ID: SM34278
2026-03-28 21:06:23 [auto1.it] INFO: Found listing with ID: EB44721
2026-03-28 21:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB44721%27 HTTP/1.1" 200 None
2026-03-28 21:06:23 [auto1.it] INFO: Scrape type for EB44721: 2
2026-03-28 21:06:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 027a31b1-7ec8-5aff-8335-9ed071bd832f with identifier: EB44721
2026-03-28 21:06:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 027a31b1-7ec8-5aff-8335-9ed071bd832f with scrape type 2
2026-03-28 21:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 027a31b1-7ec8-5aff-8335-9ed071bd832f with scrape type 2
2026-03-28 21:06:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 027a31b1-7ec8-5aff-8335-9ed071bd832f, identifier: EB44721
2026-03-28 21:06:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 027a31b1-7ec8-5aff-8335-9ed071bd832f with identifier: EB44721
2026-03-28 21:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 027a31b1-7ec8-5aff-8335-9ed071bd832f with identifier: EB44721
2026-03-28 21:06:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 027a31b1-7ec8-5aff-8335-9ed071bd832f with identifier: EB44721 to the API
2026-03-28 21:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:03:46Z',
'fuel_type': 'petrol',
'id': '027a31b1-7ec8-5aff-8335-9ed071bd832f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB44721',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra GTC',
'odometer': 208666,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-10-10',
'seller_name': None,
'title': 'Opel Astra GTC 1.8 Cosmo',
'transmission': 'manual',
'trim': 'Cosmo',
'year': 2007}
2026-03-28 21:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB44721%27 HTTP/1.1" 200 None
2026-03-28 21:06:23 [auto1.it] INFO: Saving data for EB44721: {'auction_closing_time': 1774883026.0, 'created_time': 1772655281.359485, 'last_price_update_time': 1774731983.879475}
2026-03-28 21:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EB44721') HTTP/1.1" 204 0
2026-03-28 21:06:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:23 [auto1.it] INFO: Found listing with ID: LM72883
2026-03-28 21:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM72883%27 HTTP/1.1" 200 None
2026-03-28 21:06:24 [auto1.it] INFO: Scrape type for LM72883: 0
2026-03-28 21:06:24 [auto1.it] INFO: Found listing with ID: JC85025
2026-03-28 21:06:24 [auto1.it] INFO: Found listing with ID: FC91970
2026-03-28 21:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC91970%27 HTTP/1.1" 200 None
2026-03-28 21:06:24 [auto1.it] INFO: Scrape type for FC91970: 0
2026-03-28 21:06:24 [auto1.it] INFO: Found listing with ID: PR30387
2026-03-28 21:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR30387%27 HTTP/1.1" 200 None
2026-03-28 21:06:24 [auto1.it] INFO: Scrape type for PR30387: 0
2026-03-28 21:06:24 [auto1.it] INFO: Found listing with ID: BE28605
2026-03-28 21:06:24 [auto1.it] INFO: Found listing with ID: NN68396
2026-03-28 21:06:24 [auto1.it] INFO: Found listing with ID: BS72965
2026-03-28 21:06:24 [auto1.it] INFO: Found listing with ID: JF19899
2026-03-28 21:06:24 [auto1.it] INFO: Found listing with ID: TG15136
2026-03-28 21:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG15136%27 HTTP/1.1" 200 None
2026-03-28 21:06:24 [auto1.it] INFO: Scrape type for TG15136: 2
2026-03-28 21:06:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a923c1bd-f84d-5ca4-8335-3980f7410d2a with identifier: TG15136
2026-03-28 21:06:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a923c1bd-f84d-5ca4-8335-3980f7410d2a with scrape type 2
2026-03-28 21:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a923c1bd-f84d-5ca4-8335-3980f7410d2a with scrape type 2
2026-03-28 21:06:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a923c1bd-f84d-5ca4-8335-3980f7410d2a, identifier: TG15136
2026-03-28 21:06:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a923c1bd-f84d-5ca4-8335-3980f7410d2a with identifier: TG15136
2026-03-28 21:06:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a923c1bd-f84d-5ca4-8335-3980f7410d2a with identifier: TG15136
2026-03-28 21:06:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a923c1bd-f84d-5ca4-8335-3980f7410d2a with identifier: TG15136 to the API
2026-03-28 21:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:10:45Z',
'fuel_type': 'diesel',
'id': 'a923c1bd-f84d-5ca4-8335-3980f7410d2a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG15136',
'listing': 'auction',
'make': 'Fiat',
'model': '500L',
'odometer': 207867,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-24',
'seller_name': None,
'title': 'Fiat 500L 1.6 JTDM Pop Star',
'transmission': 'manual',
'trim': 'Pop Star',
'year': 2015}
2026-03-28 21:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG15136%27 HTTP/1.1" 200 None
2026-03-28 21:06:24 [auto1.it] INFO: Saving data for TG15136: {'auction_closing_time': 1774883445.0, 'created_time': 1774533965.529707, 'last_price_update_time': 1774731984.499416}
2026-03-28 21:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TG15136') HTTP/1.1" 204 0
2026-03-28 21:06:24 [auto1.it] INFO: Found listing with ID: DT34666
2026-03-28 21:06:24 [auto1.it] INFO: Found listing with ID: YG71564
2026-03-28 21:06:24 [auto1.it] INFO: Found listing with ID: NP33035
2026-03-28 21:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP33035%27 HTTP/1.1" 200 None
2026-03-28 21:06:24 [auto1.it] INFO: Scrape type for NP33035: 0
2026-03-28 21:06:24 [auto1.it] INFO: Found listing with ID: TK41328
2026-03-28 21:06:24 [auto1.it] INFO: Found listing with ID: LH23447
2026-03-28 21:06:24 [auto1.it] INFO: Found listing with ID: NT98508
2026-03-28 21:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT98508%27 HTTP/1.1" 200 None
2026-03-28 21:06:24 [auto1.it] INFO: Scrape type for NT98508: 0
2026-03-28 21:06:24 [auto1.it] INFO: Found listing with ID: BW44627
2026-03-28 21:06:24 [auto1.it] INFO: Found listing with ID: XE50216
2026-03-28 21:06:24 [auto1.it] INFO: Found listing with ID: SN54717
2026-03-28 21:06:24 [auto1.it] INFO: Found listing with ID: RA17642
2026-03-28 21:06:24 [auto1.it] INFO: Found listing with ID: DP78893
2026-03-28 21:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP78893%27 HTTP/1.1" 200 None
2026-03-28 21:06:24 [auto1.it] INFO: Scrape type for DP78893: 0
2026-03-28 21:06:24 [auto1.it] INFO: Found listing with ID: ZR71790
2026-03-28 21:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR71790%27 HTTP/1.1" 200 None
2026-03-28 21:06:24 [auto1.it] INFO: Scrape type for ZR71790: 0
2026-03-28 21:06:24 [auto1.it] INFO: Found listing with ID: WZ23561
2026-03-28 21:06:24 [auto1.it] INFO: Found listing with ID: VS39586
2026-03-28 21:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS39586%27 HTTP/1.1" 200 None
2026-03-28 21:06:24 [auto1.it] INFO: Scrape type for VS39586: 0
2026-03-28 21:06:24 [auto1.it] INFO: Found listing with ID: HU57000
2026-03-28 21:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU57000%27 HTTP/1.1" 200 None
2026-03-28 21:06:24 [auto1.it] INFO: Scrape type for HU57000: 0
2026-03-28 21:06:24 [auto1.it] INFO: Found listing with ID: KX90230
2026-03-28 21:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:25 [auto1.it] INFO: Channel: 24h | Page: 22 | totalHits: 2224 | hits on page: 40
2026-03-28 21:06:25 [auto1.it] INFO: Found listing with ID: MZ03364
2026-03-28 21:06:25 [auto1.it] INFO: Found listing with ID: YH14903
2026-03-28 21:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH14903%27 HTTP/1.1" 200 None
2026-03-28 21:06:25 [auto1.it] INFO: Scrape type for YH14903: 0
2026-03-28 21:06:25 [auto1.it] INFO: Found listing with ID: TG59717
2026-03-28 21:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG59717%27 HTTP/1.1" 200 None
2026-03-28 21:06:25 [auto1.it] INFO: Scrape type for TG59717: 0
2026-03-28 21:06:25 [auto1.it] INFO: Found listing with ID: JP72281
2026-03-28 21:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP72281%27 HTTP/1.1" 200 None
2026-03-28 21:06:25 [auto1.it] INFO: Scrape type for JP72281: 0
2026-03-28 21:06:25 [auto1.it] INFO: Found listing with ID: DW12777
2026-03-28 21:06:25 [auto1.it] INFO: Found listing with ID: RB40748
2026-03-28 21:06:25 [auto1.it] INFO: Found listing with ID: RM58290
2026-03-28 21:06:25 [auto1.it] INFO: Found listing with ID: RY04213
2026-03-28 21:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY04213%27 HTTP/1.1" 200 None
2026-03-28 21:06:25 [auto1.it] INFO: Scrape type for RY04213: 0
2026-03-28 21:06:25 [auto1.it] INFO: Found listing with ID: UU51056
2026-03-28 21:06:25 [auto1.it] INFO: Found listing with ID: CW11036
2026-03-28 21:06:25 [auto1.it] INFO: Found listing with ID: WV91656
2026-03-28 21:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV91656%27 HTTP/1.1" 200 None
2026-03-28 21:06:25 [auto1.it] INFO: Scrape type for WV91656: 2
2026-03-28 21:06:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a9d5b74-56d6-5b96-9c72-2764de23f902 with identifier: WV91656
2026-03-28 21:06:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a9d5b74-56d6-5b96-9c72-2764de23f902 with scrape type 2
2026-03-28 21:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a9d5b74-56d6-5b96-9c72-2764de23f902 with scrape type 2
2026-03-28 21:06:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4a9d5b74-56d6-5b96-9c72-2764de23f902, identifier: WV91656
2026-03-28 21:06:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4a9d5b74-56d6-5b96-9c72-2764de23f902 with identifier: WV91656
2026-03-28 21:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4a9d5b74-56d6-5b96-9c72-2764de23f902 with identifier: WV91656
2026-03-28 21:06:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4a9d5b74-56d6-5b96-9c72-2764de23f902 with identifier: WV91656 to the API
2026-03-28 21:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:08:08Z',
'fuel_type': 'diesel',
'id': '4a9d5b74-56d6-5b96-9c72-2764de23f902',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV91656',
'listing': 'auction',
'make': 'Fiat',
'model': '500X',
'odometer': 159161,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-27',
'seller_name': None,
'title': 'Fiat 500X 1.3 M-Jet City Cross',
'transmission': 'manual',
'trim': 'City Cross',
'year': 2020}
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV91656%27 HTTP/1.1" 200 None
2026-03-28 21:06:26 [auto1.it] INFO: Saving data for WV91656: {'auction_closing_time': 1774883288.0, 'created_time': 1773130986.291658, 'last_price_update_time': 1774731986.055926}
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WV91656') HTTP/1.1" 204 0
2026-03-28 21:06:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:26 [auto1.it] INFO: Found listing with ID: RF27989
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF27989%27 HTTP/1.1" 200 None
2026-03-28 21:06:26 [auto1.it] INFO: Scrape type for RF27989: 0
2026-03-28 21:06:26 [auto1.it] INFO: Found listing with ID: EP92787
2026-03-28 21:06:26 [auto1.it] INFO: Found listing with ID: VV97216
2026-03-28 21:06:26 [auto1.it] INFO: Found listing with ID: HZ65981
2026-03-28 21:06:26 [auto1.it] INFO: Found listing with ID: PD07113
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD07113%27 HTTP/1.1" 200 None
2026-03-28 21:06:26 [auto1.it] INFO: Scrape type for PD07113: 0
2026-03-28 21:06:26 [auto1.it] INFO: Found listing with ID: KT34727
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT34727%27 HTTP/1.1" 200 None
2026-03-28 21:06:26 [auto1.it] INFO: Scrape type for KT34727: 0
2026-03-28 21:06:26 [auto1.it] INFO: Found listing with ID: WG94514
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG94514%27 HTTP/1.1" 200 None
2026-03-28 21:06:26 [auto1.it] INFO: Scrape type for WG94514: 0
2026-03-28 21:06:26 [auto1.it] INFO: Found listing with ID: EP88995
2026-03-28 21:06:26 [auto1.it] INFO: Found listing with ID: LG27793
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG27793%27 HTTP/1.1" 200 None
2026-03-28 21:06:26 [auto1.it] INFO: Scrape type for LG27793: 2
2026-03-28 21:06:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93474ab7-7d98-5465-b3d0-ab9a15c0869c with identifier: LG27793
2026-03-28 21:06:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93474ab7-7d98-5465-b3d0-ab9a15c0869c with scrape type 2
2026-03-28 21:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93474ab7-7d98-5465-b3d0-ab9a15c0869c with scrape type 2
2026-03-28 21:06:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 93474ab7-7d98-5465-b3d0-ab9a15c0869c, identifier: LG27793
2026-03-28 21:06:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 93474ab7-7d98-5465-b3d0-ab9a15c0869c with identifier: LG27793
2026-03-28 21:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 93474ab7-7d98-5465-b3d0-ab9a15c0869c with identifier: LG27793
2026-03-28 21:06:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 93474ab7-7d98-5465-b3d0-ab9a15c0869c with identifier: LG27793 to the API
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 73,
'expiration_date': '2026-03-30T15:38:10Z',
'fuel_type': 'petrol',
'id': '93474ab7-7d98-5465-b3d0-ab9a15c0869c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG27793',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 202945,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-04-29',
'seller_name': None,
'title': 'Citroen C3 1.4 Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2010}
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG27793%27 HTTP/1.1" 200 None
2026-03-28 21:06:26 [auto1.it] INFO: Saving data for LG27793: {'auction_closing_time': 1774885090.0, 'created_time': 1773136052.983807, 'last_price_update_time': 1774731986.664411}
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LG27793') HTTP/1.1" 204 0
2026-03-28 21:06:26 [auto1.it] INFO: Found listing with ID: ZR58855
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR58855%27 HTTP/1.1" 200 None
2026-03-28 21:06:26 [auto1.it] INFO: Scrape type for ZR58855: 0
2026-03-28 21:06:26 [auto1.it] INFO: Found listing with ID: HB10468
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB10468%27 HTTP/1.1" 200 None
2026-03-28 21:06:26 [auto1.it] INFO: Scrape type for HB10468: 0
2026-03-28 21:06:26 [auto1.it] INFO: Found listing with ID: BA64945
2026-03-28 21:06:26 [auto1.it] INFO: Found listing with ID: WT06044
2026-03-28 21:06:26 [auto1.it] INFO: Found listing with ID: GM73700
2026-03-28 21:06:26 [auto1.it] INFO: Found listing with ID: ER90508
2026-03-28 21:06:26 [auto1.it] INFO: Found listing with ID: VV94396
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV94396%27 HTTP/1.1" 200 None
2026-03-28 21:06:26 [auto1.it] INFO: Scrape type for VV94396: 0
2026-03-28 21:06:26 [auto1.it] INFO: Found listing with ID: RN28631
2026-03-28 21:06:26 [auto1.it] INFO: Found listing with ID: FG85862
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG85862%27 HTTP/1.1" 200 None
2026-03-28 21:06:26 [auto1.it] INFO: Scrape type for FG85862: 0
2026-03-28 21:06:26 [auto1.it] INFO: Found listing with ID: UN52705
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN52705%27 HTTP/1.1" 200 None
2026-03-28 21:06:26 [auto1.it] INFO: Scrape type for UN52705: 2
2026-03-28 21:06:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b213f9d8-9b1a-5d27-bff8-12661075e1c9 with identifier: UN52705
2026-03-28 21:06:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b213f9d8-9b1a-5d27-bff8-12661075e1c9 with scrape type 2
2026-03-28 21:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b213f9d8-9b1a-5d27-bff8-12661075e1c9 with scrape type 2
2026-03-28 21:06:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b213f9d8-9b1a-5d27-bff8-12661075e1c9, identifier: UN52705
2026-03-28 21:06:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b213f9d8-9b1a-5d27-bff8-12661075e1c9 with identifier: UN52705
2026-03-28 21:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b213f9d8-9b1a-5d27-bff8-12661075e1c9 with identifier: UN52705
2026-03-28 21:06:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b213f9d8-9b1a-5d27-bff8-12661075e1c9 with identifier: UN52705 to the API
2026-03-28 21:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:51:32Z',
'fuel_type': 'petrol',
'id': 'b213f9d8-9b1a-5d27-bff8-12661075e1c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN52705',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 114355,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-07-24',
'seller_name': None,
'title': 'Fiat 500 0.9 Lounge',
'transmission': 'automatic',
'trim': 'Lounge',
'year': 2011}
2026-03-28 21:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN52705%27 HTTP/1.1" 200 None
2026-03-28 21:06:27 [auto1.it] INFO: Saving data for UN52705: {'auction_closing_time': 1774885892.0, 'created_time': 1773129451.788939, 'last_price_update_time': 1774731987.189012}
2026-03-28 21:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UN52705') HTTP/1.1" 204 0
2026-03-28 21:06:27 [auto1.it] INFO: Found listing with ID: JJ76443
2026-03-28 21:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ76443%27 HTTP/1.1" 200 None
2026-03-28 21:06:27 [auto1.it] INFO: Scrape type for JJ76443: 0
2026-03-28 21:06:27 [auto1.it] INFO: Found listing with ID: SR58570
2026-03-28 21:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR58570%27 HTTP/1.1" 200 None
2026-03-28 21:06:27 [auto1.it] INFO: Scrape type for SR58570: 0
2026-03-28 21:06:27 [auto1.it] INFO: Found listing with ID: NE13837
2026-03-28 21:06:27 [auto1.it] INFO: Found listing with ID: AG93268
2026-03-28 21:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG93268%27 HTTP/1.1" 200 None
2026-03-28 21:06:27 [auto1.it] INFO: Scrape type for AG93268: 0
2026-03-28 21:06:27 [auto1.it] INFO: Found listing with ID: KH50025
2026-03-28 21:06:27 [auto1.it] INFO: Found listing with ID: SW20348
2026-03-28 21:06:27 [auto1.it] INFO: Found listing with ID: YM91095
2026-03-28 21:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM91095%27 HTTP/1.1" 200 None
2026-03-28 21:06:27 [auto1.it] INFO: Scrape type for YM91095: 2
2026-03-28 21:06:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42416d36-56bb-52f2-be48-9b2b7ed2638f with identifier: YM91095
2026-03-28 21:06:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42416d36-56bb-52f2-be48-9b2b7ed2638f with scrape type 2
2026-03-28 21:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42416d36-56bb-52f2-be48-9b2b7ed2638f with scrape type 2
2026-03-28 21:06:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 42416d36-56bb-52f2-be48-9b2b7ed2638f, identifier: YM91095
2026-03-28 21:06:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 42416d36-56bb-52f2-be48-9b2b7ed2638f with identifier: YM91095
2026-03-28 21:06:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 42416d36-56bb-52f2-be48-9b2b7ed2638f with identifier: YM91095
2026-03-28 21:06:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 42416d36-56bb-52f2-be48-9b2b7ed2638f with identifier: YM91095 to the API
2026-03-28 21:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:26:56Z',
'fuel_type': 'diesel',
'id': '42416d36-56bb-52f2-be48-9b2b7ed2638f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM91095',
'listing': 'auction',
'make': 'Infiniti',
'model': 'Q50',
'odometer': 148606,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-17',
'seller_name': None,
'title': 'Infiniti Q50 2.2 Diesel Q50 Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2014}
2026-03-28 21:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM91095%27 HTTP/1.1" 200 None
2026-03-28 21:06:27 [auto1.it] INFO: Saving data for YM91095: {'auction_closing_time': 1774884416.0, 'created_time': 1774343157.777365, 'last_price_update_time': 1774731987.827782}
2026-03-28 21:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YM91095') HTTP/1.1" 204 0
2026-03-28 21:06:27 [auto1.it] INFO: Found listing with ID: YD48620
2026-03-28 21:06:27 [auto1.it] INFO: Found listing with ID: CH31271
2026-03-28 21:06:27 [auto1.it] INFO: Found listing with ID: NR94524
2026-03-28 21:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:28 [auto1.it] INFO: Channel: 24h | Page: 23 | totalHits: 2224 | hits on page: 40
2026-03-28 21:06:28 [auto1.it] INFO: Found listing with ID: ME64112
2026-03-28 21:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME64112%27 HTTP/1.1" 200 None
2026-03-28 21:06:28 [auto1.it] INFO: Scrape type for ME64112: 0
2026-03-28 21:06:28 [auto1.it] INFO: Found listing with ID: NG42330
2026-03-28 21:06:28 [auto1.it] INFO: Found listing with ID: LC62662
2026-03-28 21:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC62662%27 HTTP/1.1" 200 None
2026-03-28 21:06:28 [auto1.it] INFO: Scrape type for LC62662: 0
2026-03-28 21:06:28 [auto1.it] INFO: Found listing with ID: LY59830
2026-03-28 21:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY59830%27 HTTP/1.1" 200 None
2026-03-28 21:06:28 [auto1.it] INFO: Scrape type for LY59830: 2
2026-03-28 21:06:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a41852f0-16c5-5dbe-8ca6-79b04a261aa6 with identifier: LY59830
2026-03-28 21:06:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a41852f0-16c5-5dbe-8ca6-79b04a261aa6 with scrape type 2
2026-03-28 21:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a41852f0-16c5-5dbe-8ca6-79b04a261aa6 with scrape type 2
2026-03-28 21:06:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a41852f0-16c5-5dbe-8ca6-79b04a261aa6, identifier: LY59830
2026-03-28 21:06:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a41852f0-16c5-5dbe-8ca6-79b04a261aa6 with identifier: LY59830
2026-03-28 21:06:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a41852f0-16c5-5dbe-8ca6-79b04a261aa6 with identifier: LY59830
2026-03-28 21:06:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a41852f0-16c5-5dbe-8ca6-79b04a261aa6 with identifier: LY59830 to the API
2026-03-28 21:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:12:21Z',
'fuel_type': 'diesel',
'id': 'a41852f0-16c5-5dbe-8ca6-79b04a261aa6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY59830',
'listing': 'auction',
'make': 'Fiat',
'model': '500L',
'odometer': 198032,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-09',
'seller_name': None,
'title': 'Fiat 500L 1.6 JTDM Trekking',
'transmission': 'manual',
'trim': 'Trekking',
'year': 2016}
2026-03-28 21:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY59830%27 HTTP/1.1" 200 None
2026-03-28 21:06:29 [auto1.it] INFO: Saving data for LY59830: {'auction_closing_time': 1774883541.0, 'created_time': 1774645580.422135, 'last_price_update_time': 1774731989.375621}
2026-03-28 21:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LY59830') HTTP/1.1" 204 0
2026-03-28 21:06:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:29 [auto1.it] INFO: Found listing with ID: KW57065
2026-03-28 21:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW57065%27 HTTP/1.1" 200 None
2026-03-28 21:06:29 [auto1.it] INFO: Scrape type for KW57065: 0
2026-03-28 21:06:29 [auto1.it] INFO: Found listing with ID: GZ29519
2026-03-28 21:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ29519%27 HTTP/1.1" 200 None
2026-03-28 21:06:29 [auto1.it] INFO: Scrape type for GZ29519: 0
2026-03-28 21:06:29 [auto1.it] INFO: Found listing with ID: XU45966
2026-03-28 21:06:29 [auto1.it] INFO: Found listing with ID: XP38873
2026-03-28 21:06:29 [auto1.it] INFO: Found listing with ID: UA81726
2026-03-28 21:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA81726%27 HTTP/1.1" 200 None
2026-03-28 21:06:29 [auto1.it] INFO: Scrape type for UA81726: 2
2026-03-28 21:06:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68c2ba9d-b4a5-559f-881d-42363b2efcc8 with identifier: UA81726
2026-03-28 21:06:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68c2ba9d-b4a5-559f-881d-42363b2efcc8 with scrape type 2
2026-03-28 21:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68c2ba9d-b4a5-559f-881d-42363b2efcc8 with scrape type 2
2026-03-28 21:06:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 68c2ba9d-b4a5-559f-881d-42363b2efcc8, identifier: UA81726
2026-03-28 21:06:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 68c2ba9d-b4a5-559f-881d-42363b2efcc8 with identifier: UA81726
2026-03-28 21:06:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 68c2ba9d-b4a5-559f-881d-42363b2efcc8 with identifier: UA81726
2026-03-28 21:06:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 68c2ba9d-b4a5-559f-881d-42363b2efcc8 with identifier: UA81726 to the API
2026-03-28 21:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:40:17Z',
'fuel_type': 'diesel',
'id': '68c2ba9d-b4a5-559f-881d-42363b2efcc8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA81726',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 54739,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-01',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2022}
2026-03-28 21:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA81726%27 HTTP/1.1" 200 None
2026-03-28 21:06:29 [auto1.it] INFO: Saving data for UA81726: {'auction_closing_time': 1774885217.0, 'created_time': 1774472807.465533, 'last_price_update_time': 1774731989.937491}
2026-03-28 21:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UA81726') HTTP/1.1" 204 0
2026-03-28 21:06:29 [auto1.it] INFO: Found listing with ID: LP45822
2026-03-28 21:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LP45822%27 HTTP/1.1" 200 None
2026-03-28 21:06:29 [auto1.it] INFO: Scrape type for LP45822: 0
2026-03-28 21:06:29 [auto1.it] INFO: Found listing with ID: ZZ85760
2026-03-28 21:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ85760%27 HTTP/1.1" 200 None
2026-03-28 21:06:30 [auto1.it] INFO: Scrape type for ZZ85760: 0
2026-03-28 21:06:30 [auto1.it] INFO: Found listing with ID: VY12867
2026-03-28 21:06:30 [auto1.it] INFO: Found listing with ID: NR23984
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR23984%27 HTTP/1.1" 200 None
2026-03-28 21:06:30 [auto1.it] INFO: Scrape type for NR23984: 0
2026-03-28 21:06:30 [auto1.it] INFO: Found listing with ID: ET23172
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET23172%27 HTTP/1.1" 200 None
2026-03-28 21:06:30 [auto1.it] INFO: Scrape type for ET23172: 0
2026-03-28 21:06:30 [auto1.it] INFO: Found listing with ID: TC50511
2026-03-28 21:06:30 [auto1.it] INFO: Found listing with ID: FN23706
2026-03-28 21:06:30 [auto1.it] INFO: Found listing with ID: VC63991
2026-03-28 21:06:30 [auto1.it] INFO: Found listing with ID: FK20941
2026-03-28 21:06:30 [auto1.it] INFO: Found listing with ID: ZK25944
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK25944%27 HTTP/1.1" 200 None
2026-03-28 21:06:30 [auto1.it] INFO: Scrape type for ZK25944: 0
2026-03-28 21:06:30 [auto1.it] INFO: Found listing with ID: VP99832
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP99832%27 HTTP/1.1" 200 None
2026-03-28 21:06:30 [auto1.it] INFO: Scrape type for VP99832: 2
2026-03-28 21:06:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80275b37-15d3-5188-b632-75750f66fcdb with identifier: VP99832
2026-03-28 21:06:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80275b37-15d3-5188-b632-75750f66fcdb with scrape type 2
2026-03-28 21:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80275b37-15d3-5188-b632-75750f66fcdb with scrape type 2
2026-03-28 21:06:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 80275b37-15d3-5188-b632-75750f66fcdb, identifier: VP99832
2026-03-28 21:06:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 80275b37-15d3-5188-b632-75750f66fcdb with identifier: VP99832
2026-03-28 21:06:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 80275b37-15d3-5188-b632-75750f66fcdb with identifier: VP99832
2026-03-28 21:06:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 80275b37-15d3-5188-b632-75750f66fcdb with identifier: VP99832 to the API
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:48:07Z',
'fuel_type': 'diesel',
'id': '80275b37-15d3-5188-b632-75750f66fcdb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP99832',
'listing': 'auction',
'make': 'Hyundai',
'model': 'ix35',
'odometer': 209525,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-30',
'seller_name': None,
'title': 'Hyundai ix35 1.7 CRDi XPossible 2WD',
'transmission': 'manual',
'trim': 'XPossible 2WD',
'year': 2013}
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP99832%27 HTTP/1.1" 200 None
2026-03-28 21:06:30 [auto1.it] INFO: Saving data for VP99832: {'auction_closing_time': 1774885687.0, 'created_time': 1774534022.819658, 'last_price_update_time': 1774731990.484403}
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VP99832') HTTP/1.1" 204 0
2026-03-28 21:06:30 [auto1.it] INFO: Found listing with ID: MU83341
2026-03-28 21:06:30 [auto1.it] INFO: Found listing with ID: EC55479
2026-03-28 21:06:30 [auto1.it] INFO: Found listing with ID: JE16682
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE16682%27 HTTP/1.1" 200 None
2026-03-28 21:06:30 [auto1.it] INFO: Scrape type for JE16682: 0
2026-03-28 21:06:30 [auto1.it] INFO: Found listing with ID: YH05705
2026-03-28 21:06:30 [auto1.it] INFO: Found listing with ID: VP75887
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP75887%27 HTTP/1.1" 200 None
2026-03-28 21:06:30 [auto1.it] INFO: Scrape type for VP75887: 0
2026-03-28 21:06:30 [auto1.it] INFO: Found listing with ID: DN97608
2026-03-28 21:06:30 [auto1.it] INFO: Found listing with ID: AF46529
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF46529%27 HTTP/1.1" 200 None
2026-03-28 21:06:30 [auto1.it] INFO: Scrape type for AF46529: 0
2026-03-28 21:06:30 [auto1.it] INFO: Found listing with ID: BJ63933
2026-03-28 21:06:30 [auto1.it] INFO: Found listing with ID: UT42979
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT42979%27 HTTP/1.1" 200 None
2026-03-28 21:06:30 [auto1.it] INFO: Scrape type for UT42979: 0
2026-03-28 21:06:30 [auto1.it] INFO: Found listing with ID: PA70519
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA70519%27 HTTP/1.1" 200 None
2026-03-28 21:06:30 [auto1.it] INFO: Scrape type for PA70519: 0
2026-03-28 21:06:30 [auto1.it] INFO: Found listing with ID: LW86872
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW86872%27 HTTP/1.1" 200 None
2026-03-28 21:06:30 [auto1.it] INFO: Scrape type for LW86872: 0
2026-03-28 21:06:30 [auto1.it] INFO: Found listing with ID: RS56443
2026-03-28 21:06:30 [auto1.it] INFO: Found listing with ID: LN57194
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN57194%27 HTTP/1.1" 200 None
2026-03-28 21:06:30 [auto1.it] INFO: Scrape type for LN57194: 0
2026-03-28 21:06:30 [auto1.it] INFO: Found listing with ID: PL71131
2026-03-28 21:06:30 [auto1.it] INFO: Found listing with ID: CC46702
2026-03-28 21:06:30 [auto1.it] INFO: Found listing with ID: HY22945
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY22945%27 HTTP/1.1" 200 None
2026-03-28 21:06:30 [auto1.it] INFO: Scrape type for HY22945: 0
2026-03-28 21:06:30 [auto1.it] INFO: Found listing with ID: JG85699
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JG85699%27 HTTP/1.1" 200 None
2026-03-28 21:06:30 [auto1.it] INFO: Scrape type for JG85699: 0
2026-03-28 21:06:30 [auto1.it] INFO: Found listing with ID: AK60352
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK60352%27 HTTP/1.1" 200 None
2026-03-28 21:06:30 [auto1.it] INFO: Scrape type for AK60352: 0
2026-03-28 21:06:30 [auto1.it] INFO: Found listing with ID: YA87774
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA87774%27 HTTP/1.1" 200 None
2026-03-28 21:06:30 [auto1.it] INFO: Scrape type for YA87774: 0
2026-03-28 21:06:30 [auto1.it] INFO: Found listing with ID: PN28374
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN28374%27 HTTP/1.1" 200 None
2026-03-28 21:06:30 [auto1.it] INFO: Scrape type for PN28374: 0
2026-03-28 21:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:31 [auto1.it] INFO: Channel: 24h | Page: 24 | totalHits: 2224 | hits on page: 40
2026-03-28 21:06:31 [auto1.it] INFO: Found listing with ID: AN53744
2026-03-28 21:06:31 [auto1.it] INFO: Found listing with ID: VA22015
2026-03-28 21:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VA22015%27 HTTP/1.1" 200 None
2026-03-28 21:06:31 [auto1.it] INFO: Scrape type for VA22015: 0
2026-03-28 21:06:31 [auto1.it] INFO: Found listing with ID: MR41650
2026-03-28 21:06:31 [auto1.it] INFO: Found listing with ID: KL25988
2026-03-28 21:06:31 [auto1.it] INFO: Found listing with ID: NL15395
2026-03-28 21:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL15395%27 HTTP/1.1" 200 None
2026-03-28 21:06:31 [auto1.it] INFO: Scrape type for NL15395: 0
2026-03-28 21:06:31 [auto1.it] INFO: Found listing with ID: KK35105
2026-03-28 21:06:31 [auto1.it] INFO: Found listing with ID: ZW56281
2026-03-28 21:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW56281%27 HTTP/1.1" 200 None
2026-03-28 21:06:31 [auto1.it] INFO: Scrape type for ZW56281: 0
2026-03-28 21:06:31 [auto1.it] INFO: Found listing with ID: ER51817
2026-03-28 21:06:31 [auto1.it] INFO: Found listing with ID: GZ99467
2026-03-28 21:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ99467%27 HTTP/1.1" 200 None
2026-03-28 21:06:31 [auto1.it] INFO: Scrape type for GZ99467: 0
2026-03-28 21:06:31 [auto1.it] INFO: Found listing with ID: SR85753
2026-03-28 21:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR85753%27 HTTP/1.1" 200 None
2026-03-28 21:06:31 [auto1.it] INFO: Scrape type for SR85753: 0
2026-03-28 21:06:31 [auto1.it] INFO: Found listing with ID: GB19602
2026-03-28 21:06:31 [auto1.it] INFO: Found listing with ID: WD12881
2026-03-28 21:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD12881%27 HTTP/1.1" 200 None
2026-03-28 21:06:31 [auto1.it] INFO: Scrape type for WD12881: 0
2026-03-28 21:06:31 [auto1.it] INFO: Found listing with ID: WB02861
2026-03-28 21:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB02861%27 HTTP/1.1" 200 None
2026-03-28 21:06:31 [auto1.it] INFO: Scrape type for WB02861: 2
2026-03-28 21:06:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f4fd982-1b6f-5e75-9bf3-6c05c09a2bfa with identifier: WB02861
2026-03-28 21:06:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f4fd982-1b6f-5e75-9bf3-6c05c09a2bfa with scrape type 2
2026-03-28 21:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f4fd982-1b6f-5e75-9bf3-6c05c09a2bfa with scrape type 2
2026-03-28 21:06:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4f4fd982-1b6f-5e75-9bf3-6c05c09a2bfa, identifier: WB02861
2026-03-28 21:06:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4f4fd982-1b6f-5e75-9bf3-6c05c09a2bfa with identifier: WB02861
2026-03-28 21:06:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4f4fd982-1b6f-5e75-9bf3-6c05c09a2bfa with identifier: WB02861
2026-03-28 21:06:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4f4fd982-1b6f-5e75-9bf3-6c05c09a2bfa with identifier: WB02861 to the API
2026-03-28 21:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:53:08Z',
'fuel_type': 'petrol',
'id': '4f4fd982-1b6f-5e75-9bf3-6c05c09a2bfa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB02861',
'listing': 'auction',
'make': 'Seat',
'model': 'Arona',
'odometer': 46072,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-22',
'seller_name': None,
'title': 'Seat Arona 1.5 TSI ACT FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2021}
2026-03-28 21:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB02861%27 HTTP/1.1" 200 None
2026-03-28 21:06:32 [auto1.it] INFO: Saving data for WB02861: {'auction_closing_time': 1774885988.0, 'created_time': 1774559131.824948, 'last_price_update_time': 1774731992.26494}
2026-03-28 21:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WB02861') HTTP/1.1" 204 0
2026-03-28 21:06:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:32 [auto1.it] INFO: Found listing with ID: NP37024
2026-03-28 21:06:32 [auto1.it] INFO: Found listing with ID: YG18213
2026-03-28 21:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG18213%27 HTTP/1.1" 200 None
2026-03-28 21:06:32 [auto1.it] INFO: Scrape type for YG18213: 2
2026-03-28 21:06:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64cf1429-3535-5855-93c1-c020a281df48 with identifier: YG18213
2026-03-28 21:06:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64cf1429-3535-5855-93c1-c020a281df48 with scrape type 2
2026-03-28 21:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64cf1429-3535-5855-93c1-c020a281df48 with scrape type 2
2026-03-28 21:06:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 64cf1429-3535-5855-93c1-c020a281df48, identifier: YG18213
2026-03-28 21:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 64cf1429-3535-5855-93c1-c020a281df48 with identifier: YG18213
2026-03-28 21:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 64cf1429-3535-5855-93c1-c020a281df48 with identifier: YG18213
2026-03-28 21:06:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 64cf1429-3535-5855-93c1-c020a281df48 with identifier: YG18213 to the API
2026-03-28 21:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:52:51Z',
'fuel_type': 'diesel',
'id': '64cf1429-3535-5855-93c1-c020a281df48',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG18213',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLB-Klasse',
'odometer': 68327,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-06',
'seller_name': None,
'title': 'Mercedes-Benz GLB-Klasse GLB 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2022}
2026-03-28 21:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG18213%27 HTTP/1.1" 200 None
2026-03-28 21:06:32 [auto1.it] INFO: Saving data for YG18213: {'auction_closing_time': 1774885971.0, 'created_time': 1774645553.861316, 'last_price_update_time': 1774731992.771386}
2026-03-28 21:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YG18213') HTTP/1.1" 204 0
2026-03-28 21:06:32 [auto1.it] INFO: Found listing with ID: NA90799
2026-03-28 21:06:32 [auto1.it] INFO: Found listing with ID: JB43722
2026-03-28 21:06:32 [auto1.it] INFO: Found listing with ID: SY65620
2026-03-28 21:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY65620%27 HTTP/1.1" 200 None
2026-03-28 21:06:32 [auto1.it] INFO: Scrape type for SY65620: 2
2026-03-28 21:06:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 530c0fbe-e587-5e67-889a-be21c6db12a6 with identifier: SY65620
2026-03-28 21:06:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 530c0fbe-e587-5e67-889a-be21c6db12a6 with scrape type 2
2026-03-28 21:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 530c0fbe-e587-5e67-889a-be21c6db12a6 with scrape type 2
2026-03-28 21:06:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 530c0fbe-e587-5e67-889a-be21c6db12a6, identifier: SY65620
2026-03-28 21:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 530c0fbe-e587-5e67-889a-be21c6db12a6 with identifier: SY65620
2026-03-28 21:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 530c0fbe-e587-5e67-889a-be21c6db12a6 with identifier: SY65620
2026-03-28 21:06:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 530c0fbe-e587-5e67-889a-be21c6db12a6 with identifier: SY65620 to the API
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:40:52Z',
'fuel_type': 'diesel',
'id': '530c0fbe-e587-5e67-889a-be21c6db12a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY65620',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 141474,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-03-12',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 CDI Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2008}
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY65620%27 HTTP/1.1" 200 None
2026-03-28 21:06:33 [auto1.it] INFO: Saving data for SY65620: {'auction_closing_time': 1774885252.0, 'created_time': 1774127302.107533, 'last_price_update_time': 1774731993.236147}
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SY65620') HTTP/1.1" 204 0
2026-03-28 21:06:33 [auto1.it] INFO: Found listing with ID: VC37401
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC37401%27 HTTP/1.1" 200 None
2026-03-28 21:06:33 [auto1.it] INFO: Scrape type for VC37401: 0
2026-03-28 21:06:33 [auto1.it] INFO: Found listing with ID: JB22661
2026-03-28 21:06:33 [auto1.it] INFO: Found listing with ID: PS88419
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS88419%27 HTTP/1.1" 200 None
2026-03-28 21:06:33 [auto1.it] INFO: Scrape type for PS88419: 0
2026-03-28 21:06:33 [auto1.it] INFO: Found listing with ID: CH30071
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH30071%27 HTTP/1.1" 200 None
2026-03-28 21:06:33 [auto1.it] INFO: Scrape type for CH30071: 0
2026-03-28 21:06:33 [auto1.it] INFO: Found listing with ID: WP29588
2026-03-28 21:06:33 [auto1.it] INFO: Found listing with ID: SG58934
2026-03-28 21:06:33 [auto1.it] INFO: Found listing with ID: EH79430
2026-03-28 21:06:33 [auto1.it] INFO: Found listing with ID: ZE54964
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE54964%27 HTTP/1.1" 200 None
2026-03-28 21:06:33 [auto1.it] INFO: Scrape type for ZE54964: 0
2026-03-28 21:06:33 [auto1.it] INFO: Found listing with ID: ZY20684
2026-03-28 21:06:33 [auto1.it] INFO: Found listing with ID: SH99694
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH99694%27 HTTP/1.1" 200 None
2026-03-28 21:06:33 [auto1.it] INFO: Scrape type for SH99694: 0
2026-03-28 21:06:33 [auto1.it] INFO: Found listing with ID: YD47870
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD47870%27 HTTP/1.1" 200 None
2026-03-28 21:06:33 [auto1.it] INFO: Scrape type for YD47870: 0
2026-03-28 21:06:33 [auto1.it] INFO: Found listing with ID: HP26181
2026-03-28 21:06:33 [auto1.it] INFO: Found listing with ID: CA11225
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA11225%27 HTTP/1.1" 200 None
2026-03-28 21:06:33 [auto1.it] INFO: Scrape type for CA11225: 2
2026-03-28 21:06:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6c25724-f523-57e4-a9cc-8c99b31357ed with identifier: CA11225
2026-03-28 21:06:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6c25724-f523-57e4-a9cc-8c99b31357ed with scrape type 2
2026-03-28 21:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6c25724-f523-57e4-a9cc-8c99b31357ed with scrape type 2
2026-03-28 21:06:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e6c25724-f523-57e4-a9cc-8c99b31357ed, identifier: CA11225
2026-03-28 21:06:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e6c25724-f523-57e4-a9cc-8c99b31357ed with identifier: CA11225
2026-03-28 21:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e6c25724-f523-57e4-a9cc-8c99b31357ed with identifier: CA11225
2026-03-28 21:06:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e6c25724-f523-57e4-a9cc-8c99b31357ed with identifier: CA11225 to the API
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:39:34Z',
'fuel_type': 'diesel',
'id': 'e6c25724-f523-57e4-a9cc-8c99b31357ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA11225',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 243910,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-11-12',
'seller_name': None,
'title': 'BMW X1 xDrive 20d',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA11225%27 HTTP/1.1" 200 None
2026-03-28 21:06:33 [auto1.it] INFO: Saving data for CA11225: {'auction_closing_time': 1774885174.0, 'created_time': 1774645586.258443, 'last_price_update_time': 1774731993.782673}
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CA11225') HTTP/1.1" 204 0
2026-03-28 21:06:33 [auto1.it] INFO: Found listing with ID: GZ15334
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ15334%27 HTTP/1.1" 200 None
2026-03-28 21:06:33 [auto1.it] INFO: Scrape type for GZ15334: 0
2026-03-28 21:06:33 [auto1.it] INFO: Found listing with ID: NR19227
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR19227%27 HTTP/1.1" 200 None
2026-03-28 21:06:33 [auto1.it] INFO: Scrape type for NR19227: 0
2026-03-28 21:06:33 [auto1.it] INFO: Found listing with ID: PE03343
2026-03-28 21:06:33 [auto1.it] INFO: Found listing with ID: CD48597
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD48597%27 HTTP/1.1" 200 None
2026-03-28 21:06:33 [auto1.it] INFO: Scrape type for CD48597: 2
2026-03-28 21:06:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7830dcc9-07ed-5b48-a214-155f1041a33c with identifier: CD48597
2026-03-28 21:06:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7830dcc9-07ed-5b48-a214-155f1041a33c with scrape type 2
2026-03-28 21:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7830dcc9-07ed-5b48-a214-155f1041a33c with scrape type 2
2026-03-28 21:06:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7830dcc9-07ed-5b48-a214-155f1041a33c, identifier: CD48597
2026-03-28 21:06:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7830dcc9-07ed-5b48-a214-155f1041a33c with identifier: CD48597
2026-03-28 21:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7830dcc9-07ed-5b48-a214-155f1041a33c with identifier: CD48597
2026-03-28 21:06:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7830dcc9-07ed-5b48-a214-155f1041a33c with identifier: CD48597 to the API
2026-03-28 21:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:16:12Z',
'fuel_type': 'hybrid',
'id': '7830dcc9-07ed-5b48-a214-155f1041a33c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD48597',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 59897,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-02',
'seller_name': None,
'title': 'Renault Captur 1.6 Hybrid E-Tech Techno Fast Track',
'transmission': 'automatic',
'trim': 'Techno Fast Track',
'year': 2022}
2026-03-28 21:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD48597%27 HTTP/1.1" 200 None
2026-03-28 21:06:34 [auto1.it] INFO: Saving data for CD48597: {'auction_closing_time': 1774883772.0, 'created_time': 1774645547.787258, 'last_price_update_time': 1774731994.345178}
2026-03-28 21:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CD48597') HTTP/1.1" 204 0
2026-03-28 21:06:34 [auto1.it] INFO: Found listing with ID: MG44195
2026-03-28 21:06:34 [auto1.it] INFO: Found listing with ID: ZL42866
2026-03-28 21:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL42866%27 HTTP/1.1" 200 None
2026-03-28 21:06:34 [auto1.it] INFO: Scrape type for ZL42866: 2
2026-03-28 21:06:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5e04701-ee8e-5243-bc97-4c711bcb55cf with identifier: ZL42866
2026-03-28 21:06:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5e04701-ee8e-5243-bc97-4c711bcb55cf with scrape type 2
2026-03-28 21:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5e04701-ee8e-5243-bc97-4c711bcb55cf with scrape type 2
2026-03-28 21:06:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f5e04701-ee8e-5243-bc97-4c711bcb55cf, identifier: ZL42866
2026-03-28 21:06:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f5e04701-ee8e-5243-bc97-4c711bcb55cf with identifier: ZL42866
2026-03-28 21:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f5e04701-ee8e-5243-bc97-4c711bcb55cf with identifier: ZL42866
2026-03-28 21:06:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f5e04701-ee8e-5243-bc97-4c711bcb55cf with identifier: ZL42866 to the API
2026-03-28 21:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 300,
'expiration_date': '2026-03-30T15:24:41Z',
'fuel_type': 'petrol',
'id': 'f5e04701-ee8e-5243-bc97-4c711bcb55cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL42866',
'listing': 'auction',
'make': 'Cupra',
'model': 'Ateca',
'odometer': 84337,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-29',
'seller_name': None,
'title': 'Cupra Ateca 2.0 TSI 4Drive',
'transmission': 'automatic',
'trim': '4Drive',
'year': 2019}
2026-03-28 21:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL42866%27 HTTP/1.1" 200 None
2026-03-28 21:06:34 [auto1.it] INFO: Saving data for ZL42866: {'auction_closing_time': 1774884281.0, 'created_time': 1774127266.517366, 'last_price_update_time': 1774731994.765873}
2026-03-28 21:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZL42866') HTTP/1.1" 204 0
2026-03-28 21:06:34 [auto1.it] INFO: Found listing with ID: TD16332
2026-03-28 21:06:34 [auto1.it] INFO: Found listing with ID: FZ15341
2026-03-28 21:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ15341%27 HTTP/1.1" 200 None
2026-03-28 21:06:34 [auto1.it] INFO: Scrape type for FZ15341: 0
2026-03-28 21:06:34 [auto1.it] INFO: Found listing with ID: XX72612
2026-03-28 21:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:35 [auto1.it] INFO: Channel: 24h | Page: 25 | totalHits: 2224 | hits on page: 40
2026-03-28 21:06:35 [auto1.it] INFO: Found listing with ID: FB65897
2026-03-28 21:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FB65897%27 HTTP/1.1" 200 None
2026-03-28 21:06:35 [auto1.it] INFO: Scrape type for FB65897: 0
2026-03-28 21:06:35 [auto1.it] INFO: Found listing with ID: LU21739
2026-03-28 21:06:35 [auto1.it] INFO: Found listing with ID: JD30560
2026-03-28 21:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD30560%27 HTTP/1.1" 200 None
2026-03-28 21:06:35 [auto1.it] INFO: Scrape type for JD30560: 0
2026-03-28 21:06:35 [auto1.it] INFO: Found listing with ID: UJ60071
2026-03-28 21:06:35 [auto1.it] INFO: Found listing with ID: WM75200
2026-03-28 21:06:35 [auto1.it] INFO: Found listing with ID: TW16481
2026-03-28 21:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW16481%27 HTTP/1.1" 200 None
2026-03-28 21:06:35 [auto1.it] INFO: Scrape type for TW16481: 1
2026-03-28 21:06:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:35 [auto1.it] INFO: Found listing with ID: RS41050
2026-03-28 21:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS41050%27 HTTP/1.1" 200 None
2026-03-28 21:06:35 [auto1.it] INFO: Scrape type for RS41050: 0
2026-03-28 21:06:35 [auto1.it] INFO: Found listing with ID: XJ00543
2026-03-28 21:06:35 [auto1.it] INFO: Found listing with ID: HG18459
2026-03-28 21:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG18459%27 HTTP/1.1" 200 None
2026-03-28 21:06:35 [auto1.it] INFO: Scrape type for HG18459: 0
2026-03-28 21:06:35 [auto1.it] INFO: Found listing with ID: HE90318
2026-03-28 21:06:35 [auto1.it] INFO: Found listing with ID: KD38461
2026-03-28 21:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD38461%27 HTTP/1.1" 200 None
2026-03-28 21:06:35 [auto1.it] INFO: Scrape type for KD38461: 0
2026-03-28 21:06:35 [auto1.it] INFO: Found listing with ID: YX10047
2026-03-28 21:06:35 [auto1.it] INFO: Found listing with ID: JZ67202
2026-03-28 21:06:35 [auto1.it] INFO: Found listing with ID: HS22192
2026-03-28 21:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS22192%27 HTTP/1.1" 200 None
2026-03-28 21:06:35 [auto1.it] INFO: Scrape type for HS22192: 0
2026-03-28 21:06:35 [auto1.it] INFO: Found listing with ID: UA91591
2026-03-28 21:06:35 [auto1.it] INFO: Found listing with ID: VC28315
2026-03-28 21:06:35 [auto1.it] INFO: Found listing with ID: XC32215
2026-03-28 21:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC32215%27 HTTP/1.1" 200 None
2026-03-28 21:06:35 [auto1.it] INFO: Scrape type for XC32215: 0
2026-03-28 21:06:35 [auto1.it] INFO: Found listing with ID: VJ93406
2026-03-28 21:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ93406%27 HTTP/1.1" 200 None
2026-03-28 21:06:35 [auto1.it] INFO: Scrape type for VJ93406: 0
2026-03-28 21:06:35 [auto1.it] INFO: Found listing with ID: PE96276
2026-03-28 21:06:35 [auto1.it] INFO: Found listing with ID: HA39708
2026-03-28 21:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA39708%27 HTTP/1.1" 200 None
2026-03-28 21:06:35 [auto1.it] INFO: Scrape type for HA39708: 0
2026-03-28 21:06:35 [auto1.it] INFO: Found listing with ID: SG53706
2026-03-28 21:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG53706%27 HTTP/1.1" 200 None
2026-03-28 21:06:36 [auto1.it] INFO: Scrape type for SG53706: 0
2026-03-28 21:06:36 [auto1.it] INFO: Found listing with ID: SU56229
2026-03-28 21:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU56229%27 HTTP/1.1" 200 None
2026-03-28 21:06:36 [auto1.it] INFO: Scrape type for SU56229: 0
2026-03-28 21:06:36 [auto1.it] INFO: Found listing with ID: RL61545
2026-03-28 21:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL61545%27 HTTP/1.1" 200 None
2026-03-28 21:06:36 [auto1.it] INFO: Scrape type for RL61545: 0
2026-03-28 21:06:36 [auto1.it] INFO: Found listing with ID: XC82626
2026-03-28 21:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC82626%27 HTTP/1.1" 200 None
2026-03-28 21:06:36 [auto1.it] INFO: Scrape type for XC82626: 0
2026-03-28 21:06:36 [auto1.it] INFO: Found listing with ID: CU47897
2026-03-28 21:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU47897%27 HTTP/1.1" 200 None
2026-03-28 21:06:36 [auto1.it] INFO: Scrape type for CU47897: 0
2026-03-28 21:06:36 [auto1.it] INFO: Found listing with ID: PN01400
2026-03-28 21:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN01400%27 HTTP/1.1" 200 None
2026-03-28 21:06:36 [auto1.it] INFO: Scrape type for PN01400: 0
2026-03-28 21:06:36 [auto1.it] INFO: Found listing with ID: YW98083
2026-03-28 21:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW98083%27 HTTP/1.1" 200 None
2026-03-28 21:06:36 [auto1.it] INFO: Scrape type for YW98083: 2
2026-03-28 21:06:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e59d9798-b200-50b6-afb1-6037cfd84e02 with identifier: YW98083
2026-03-28 21:06:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e59d9798-b200-50b6-afb1-6037cfd84e02 with scrape type 2
2026-03-28 21:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e59d9798-b200-50b6-afb1-6037cfd84e02 with scrape type 2
2026-03-28 21:06:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e59d9798-b200-50b6-afb1-6037cfd84e02, identifier: YW98083
2026-03-28 21:06:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e59d9798-b200-50b6-afb1-6037cfd84e02 with identifier: YW98083
2026-03-28 21:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e59d9798-b200-50b6-afb1-6037cfd84e02 with identifier: YW98083
2026-03-28 21:06:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e59d9798-b200-50b6-afb1-6037cfd84e02 with identifier: YW98083 to the API
2026-03-28 21:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:12:51Z',
'fuel_type': 'diesel',
'id': 'e59d9798-b200-50b6-afb1-6037cfd84e02',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW98083',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 180225,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-29',
'seller_name': None,
'title': 'Ford Fiesta 1.5 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2015}
2026-03-28 21:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW98083%27 HTTP/1.1" 200 None
2026-03-28 21:06:36 [auto1.it] INFO: Saving data for YW98083: {'auction_closing_time': 1774883571.0, 'created_time': 1773135955.834511, 'last_price_update_time': 1774731996.530031}
2026-03-28 21:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YW98083') HTTP/1.1" 204 0
2026-03-28 21:06:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:36 [auto1.it] INFO: Found listing with ID: SS15336
2026-03-28 21:06:36 [auto1.it] INFO: Found listing with ID: XA66823
2026-03-28 21:06:36 [auto1.it] INFO: Found listing with ID: MM82110
2026-03-28 21:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MM82110%27 HTTP/1.1" 200 None
2026-03-28 21:06:36 [auto1.it] INFO: Scrape type for MM82110: 2
2026-03-28 21:06:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c7d1277-be09-57dc-a141-c5d048db43a1 with identifier: MM82110
2026-03-28 21:06:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c7d1277-be09-57dc-a141-c5d048db43a1 with scrape type 2
2026-03-28 21:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c7d1277-be09-57dc-a141-c5d048db43a1 with scrape type 2
2026-03-28 21:06:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1c7d1277-be09-57dc-a141-c5d048db43a1, identifier: MM82110
2026-03-28 21:06:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1c7d1277-be09-57dc-a141-c5d048db43a1 with identifier: MM82110
2026-03-28 21:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1c7d1277-be09-57dc-a141-c5d048db43a1 with identifier: MM82110
2026-03-28 21:06:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1c7d1277-be09-57dc-a141-c5d048db43a1 with identifier: MM82110 to the API
2026-03-28 21:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:49:26Z',
'fuel_type': 'petrol',
'id': '1c7d1277-be09-57dc-a141-c5d048db43a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM82110',
'listing': 'auction',
'make': 'Lancia',
'model': 'Ypsilon',
'odometer': 105886,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-22',
'seller_name': None,
'title': 'Lancia Ypsilon 1.2 Gold',
'transmission': 'manual',
'trim': 'Gold',
'year': 2014}
2026-03-28 21:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MM82110%27 HTTP/1.1" 200 None
2026-03-28 21:06:37 [auto1.it] INFO: Saving data for MM82110: {'auction_closing_time': 1774885766.0, 'created_time': 1774559138.683744, 'last_price_update_time': 1774731997.07144}
2026-03-28 21:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MM82110') HTTP/1.1" 204 0
2026-03-28 21:06:37 [auto1.it] INFO: Found listing with ID: YM64414
2026-03-28 21:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM64414%27 HTTP/1.1" 200 None
2026-03-28 21:06:37 [auto1.it] INFO: Scrape type for YM64414: 0
2026-03-28 21:06:37 [auto1.it] INFO: Found listing with ID: EG94847
2026-03-28 21:06:37 [auto1.it] INFO: Found listing with ID: BX20882
2026-03-28 21:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX20882%27 HTTP/1.1" 200 None
2026-03-28 21:06:37 [auto1.it] INFO: Scrape type for BX20882: 0
2026-03-28 21:06:37 [auto1.it] INFO: Found listing with ID: KW88913
2026-03-28 21:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW88913%27 HTTP/1.1" 200 None
2026-03-28 21:06:37 [auto1.it] INFO: Scrape type for KW88913: 0
2026-03-28 21:06:37 [auto1.it] INFO: Found listing with ID: MD14180
2026-03-28 21:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD14180%27 HTTP/1.1" 200 None
2026-03-28 21:06:37 [auto1.it] INFO: Scrape type for MD14180: 0
2026-03-28 21:06:37 [auto1.it] INFO: Found listing with ID: RJ76809
2026-03-28 21:06:37 [auto1.it] INFO: Found listing with ID: YT99583
2026-03-28 21:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT99583%27 HTTP/1.1" 200 None
2026-03-28 21:06:37 [auto1.it] INFO: Scrape type for YT99583: 2
2026-03-28 21:06:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b788145-175d-5e22-a789-3023340c6fe2 with identifier: YT99583
2026-03-28 21:06:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b788145-175d-5e22-a789-3023340c6fe2 with scrape type 2
2026-03-28 21:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b788145-175d-5e22-a789-3023340c6fe2 with scrape type 2
2026-03-28 21:06:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8b788145-175d-5e22-a789-3023340c6fe2, identifier: YT99583
2026-03-28 21:06:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8b788145-175d-5e22-a789-3023340c6fe2 with identifier: YT99583
2026-03-28 21:06:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8b788145-175d-5e22-a789-3023340c6fe2 with identifier: YT99583
2026-03-28 21:06:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8b788145-175d-5e22-a789-3023340c6fe2 with identifier: YT99583 to the API
2026-03-28 21:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:25:16Z',
'fuel_type': 'diesel',
'id': '8b788145-175d-5e22-a789-3023340c6fe2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT99583',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 28014,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-19',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Life 4Motion',
'transmission': 'automatic',
'trim': 'Life 4Motion',
'year': 2022}
2026-03-28 21:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT99583%27 HTTP/1.1" 200 None
2026-03-28 21:06:37 [auto1.it] INFO: Saving data for YT99583: {'auction_closing_time': 1774884316.0, 'created_time': 1774343210.502551, 'last_price_update_time': 1774731997.574536}
2026-03-28 21:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YT99583') HTTP/1.1" 204 0
2026-03-28 21:06:37 [auto1.it] INFO: Found listing with ID: MS79311
2026-03-28 21:06:37 [auto1.it] INFO: Found listing with ID: WU32452
2026-03-28 21:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU32452%27 HTTP/1.1" 200 None
2026-03-28 21:06:37 [auto1.it] INFO: Scrape type for WU32452: 0
2026-03-28 21:06:37 [auto1.it] INFO: Found listing with ID: BL33415
2026-03-28 21:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:38 [auto1.it] INFO: Channel: 24h | Page: 26 | totalHits: 2224 | hits on page: 40
2026-03-28 21:06:38 [auto1.it] INFO: Found listing with ID: ZJ46829
2026-03-28 21:06:38 [auto1.it] INFO: Found listing with ID: JK56818
2026-03-28 21:06:38 [auto1.it] INFO: Found listing with ID: JD30640
2026-03-28 21:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD30640%27 HTTP/1.1" 200 None
2026-03-28 21:06:38 [auto1.it] INFO: Scrape type for JD30640: 0
2026-03-28 21:06:38 [auto1.it] INFO: Found listing with ID: ZJ21397
2026-03-28 21:06:38 [auto1.it] INFO: Found listing with ID: MZ03960
2026-03-28 21:06:38 [auto1.it] INFO: Found listing with ID: MV49803
2026-03-28 21:06:38 [auto1.it] INFO: Found listing with ID: JL83365
2026-03-28 21:06:38 [auto1.it] INFO: Found listing with ID: UX28393
2026-03-28 21:06:38 [auto1.it] INFO: Found listing with ID: MU61390
2026-03-28 21:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU61390%27 HTTP/1.1" 200 None
2026-03-28 21:06:38 [auto1.it] INFO: Scrape type for MU61390: 0
2026-03-28 21:06:38 [auto1.it] INFO: Found listing with ID: HY18936
2026-03-28 21:06:38 [auto1.it] INFO: Found listing with ID: PV59173
2026-03-28 21:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV59173%27 HTTP/1.1" 200 None
2026-03-28 21:06:38 [auto1.it] INFO: Scrape type for PV59173: 0
2026-03-28 21:06:38 [auto1.it] INFO: Found listing with ID: VY08559
2026-03-28 21:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY08559%27 HTTP/1.1" 200 None
2026-03-28 21:06:38 [auto1.it] INFO: Scrape type for VY08559: 0
2026-03-28 21:06:38 [auto1.it] INFO: Found listing with ID: YU18545
2026-03-28 21:06:38 [auto1.it] INFO: Found listing with ID: UR28230
2026-03-28 21:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR28230%27 HTTP/1.1" 200 None
2026-03-28 21:06:38 [auto1.it] INFO: Scrape type for UR28230: 2
2026-03-28 21:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c039e70-a692-5d27-8ba9-cd0e90e5e553 with identifier: UR28230
2026-03-28 21:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c039e70-a692-5d27-8ba9-cd0e90e5e553 with scrape type 2
2026-03-28 21:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c039e70-a692-5d27-8ba9-cd0e90e5e553 with scrape type 2
2026-03-28 21:06:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3c039e70-a692-5d27-8ba9-cd0e90e5e553, identifier: UR28230
2026-03-28 21:06:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3c039e70-a692-5d27-8ba9-cd0e90e5e553 with identifier: UR28230
2026-03-28 21:06:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3c039e70-a692-5d27-8ba9-cd0e90e5e553 with identifier: UR28230
2026-03-28 21:06:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3c039e70-a692-5d27-8ba9-cd0e90e5e553 with identifier: UR28230 to the API
2026-03-28 21:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:02:38Z',
'fuel_type': 'diesel',
'id': '3c039e70-a692-5d27-8ba9-cd0e90e5e553',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR28230',
'listing': 'auction',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 201315,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-22',
'seller_name': None,
'title': 'Audi A1 Sportback 1.6 TDI Metal plus',
'transmission': 'manual',
'trim': 'Metal plus',
'year': 2018}
2026-03-28 21:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR28230%27 HTTP/1.1" 200 None
2026-03-28 21:06:38 [auto1.it] INFO: Saving data for UR28230: {'auction_closing_time': 1774882958.0, 'created_time': 1774645545.11246, 'last_price_update_time': 1774731998.949173}
2026-03-28 21:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UR28230') HTTP/1.1" 204 0
2026-03-28 21:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:39 [auto1.it] INFO: Found listing with ID: XJ39462
2026-03-28 21:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ39462%27 HTTP/1.1" 200 None
2026-03-28 21:06:39 [auto1.it] INFO: Scrape type for XJ39462: 0
2026-03-28 21:06:39 [auto1.it] INFO: Found listing with ID: DK87302
2026-03-28 21:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK87302%27 HTTP/1.1" 200 None
2026-03-28 21:06:39 [auto1.it] INFO: Scrape type for DK87302: 0
2026-03-28 21:06:39 [auto1.it] INFO: Found listing with ID: FN50437
2026-03-28 21:06:39 [auto1.it] INFO: Found listing with ID: WD34729
2026-03-28 21:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD34729%27 HTTP/1.1" 200 None
2026-03-28 21:06:39 [auto1.it] INFO: Scrape type for WD34729: 0
2026-03-28 21:06:39 [auto1.it] INFO: Found listing with ID: HK70439
2026-03-28 21:06:39 [auto1.it] INFO: Found listing with ID: EP08968
2026-03-28 21:06:39 [auto1.it] INFO: Found listing with ID: EY33952
2026-03-28 21:06:39 [auto1.it] INFO: Found listing with ID: LB07538
2026-03-28 21:06:39 [auto1.it] INFO: Found listing with ID: KG02437
2026-03-28 21:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KG02437%27 HTTP/1.1" 200 None
2026-03-28 21:06:39 [auto1.it] INFO: Scrape type for KG02437: 0
2026-03-28 21:06:39 [auto1.it] INFO: Found listing with ID: PY21369
2026-03-28 21:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY21369%27 HTTP/1.1" 200 None
2026-03-28 21:06:39 [auto1.it] INFO: Scrape type for PY21369: 0
2026-03-28 21:06:39 [auto1.it] INFO: Found listing with ID: BE36594
2026-03-28 21:06:39 [auto1.it] INFO: Found listing with ID: YH78085
2026-03-28 21:06:39 [auto1.it] INFO: Found listing with ID: VM78443
2026-03-28 21:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM78443%27 HTTP/1.1" 200 None
2026-03-28 21:06:39 [auto1.it] INFO: Scrape type for VM78443: 0
2026-03-28 21:06:39 [auto1.it] INFO: Found listing with ID: LZ72377
2026-03-28 21:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ72377%27 HTTP/1.1" 200 None
2026-03-28 21:06:39 [auto1.it] INFO: Scrape type for LZ72377: 0
2026-03-28 21:06:39 [auto1.it] INFO: Found listing with ID: MS56995
2026-03-28 21:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MS56995%27 HTTP/1.1" 200 None
2026-03-28 21:06:39 [auto1.it] INFO: Scrape type for MS56995: 0
2026-03-28 21:06:39 [auto1.it] INFO: Found listing with ID: XY41121
2026-03-28 21:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY41121%27 HTTP/1.1" 200 None
2026-03-28 21:06:39 [auto1.it] INFO: Scrape type for XY41121: 0
2026-03-28 21:06:39 [auto1.it] INFO: Found listing with ID: CS68621
2026-03-28 21:06:39 [auto1.it] INFO: Found listing with ID: HG73673
2026-03-28 21:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG73673%27 HTTP/1.1" 200 None
2026-03-28 21:06:39 [auto1.it] INFO: Scrape type for HG73673: 0
2026-03-28 21:06:39 [auto1.it] INFO: Found listing with ID: GX81106
2026-03-28 21:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX81106%27 HTTP/1.1" 200 None
2026-03-28 21:06:39 [auto1.it] INFO: Scrape type for GX81106: 0
2026-03-28 21:06:39 [auto1.it] INFO: Found listing with ID: HK94664
2026-03-28 21:06:39 [auto1.it] INFO: Found listing with ID: GF63115
2026-03-28 21:06:39 [auto1.it] INFO: Found listing with ID: PA21374
2026-03-28 21:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA21374%27 HTTP/1.1" 200 None
2026-03-28 21:06:39 [auto1.it] INFO: Scrape type for PA21374: 0
2026-03-28 21:06:39 [auto1.it] INFO: Found listing with ID: NW58325
2026-03-28 21:06:39 [auto1.it] INFO: Found listing with ID: GT90583
2026-03-28 21:06:39 [auto1.it] INFO: Found listing with ID: DX18897
2026-03-28 21:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX18897%27 HTTP/1.1" 200 None
2026-03-28 21:06:39 [auto1.it] INFO: Scrape type for DX18897: 0
2026-03-28 21:06:39 [auto1.it] INFO: Found listing with ID: FC73004
2026-03-28 21:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC73004%27 HTTP/1.1" 200 None
2026-03-28 21:06:39 [auto1.it] INFO: Scrape type for FC73004: 0
2026-03-28 21:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TW16481/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:40 [auto1.it] INFO: Channel: 24h | Page: 27 | totalHits: 2224 | hits on page: 40
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: ZX72389
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: LS28867
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS28867%27 HTTP/1.1" 200 None
2026-03-28 21:06:40 [auto1.it] INFO: Scrape type for LS28867: 0
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: EZ27389
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ27389%27 HTTP/1.1" 200 None
2026-03-28 21:06:40 [auto1.it] INFO: Scrape type for EZ27389: 0
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: EZ66710
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ66710%27 HTTP/1.1" 200 None
2026-03-28 21:06:40 [auto1.it] INFO: Scrape type for EZ66710: 0
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: WP21128
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: DP87516
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP87516%27 HTTP/1.1" 200 None
2026-03-28 21:06:40 [auto1.it] INFO: Scrape type for DP87516: 0
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: DV60834
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV60834%27 HTTP/1.1" 200 None
2026-03-28 21:06:40 [auto1.it] INFO: Scrape type for DV60834: 0
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: PS94410
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: TG24306
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG24306%27 HTTP/1.1" 200 None
2026-03-28 21:06:40 [auto1.it] INFO: Scrape type for TG24306: 0
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: TK35909
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: CT52714
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: PC99456
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC99456%27 HTTP/1.1" 200 None
2026-03-28 21:06:40 [auto1.it] INFO: Scrape type for PC99456: 0
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: JU67462
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: CG84087
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: JU78402
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU78402%27 HTTP/1.1" 200 None
2026-03-28 21:06:40 [auto1.it] INFO: Scrape type for JU78402: 0
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: VE26782
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE26782%27 HTTP/1.1" 200 None
2026-03-28 21:06:40 [auto1.it] INFO: Scrape type for VE26782: 0
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: AE85133
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: PK65337
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: UX29999
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: UB12324
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: UU69652
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU69652%27 HTTP/1.1" 200 None
2026-03-28 21:06:40 [auto1.it] INFO: Scrape type for UU69652: 0
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: CZ68446
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ68446%27 HTTP/1.1" 200 None
2026-03-28 21:06:40 [auto1.it] INFO: Scrape type for CZ68446: 0
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: WH17825
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WH17825%27 HTTP/1.1" 200 None
2026-03-28 21:06:40 [auto1.it] INFO: Scrape type for WH17825: 0
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: MT44233
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: HR66434
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR66434%27 HTTP/1.1" 200 None
2026-03-28 21:06:40 [auto1.it] INFO: Scrape type for HR66434: 0
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: YK06699
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK06699%27 HTTP/1.1" 200 None
2026-03-28 21:06:40 [auto1.it] INFO: Scrape type for YK06699: 0
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: UR14764
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR14764%27 HTTP/1.1" 200 None
2026-03-28 21:06:40 [auto1.it] INFO: Scrape type for UR14764: 0
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: GF05972
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GF05972%27 HTTP/1.1" 200 None
2026-03-28 21:06:40 [auto1.it] INFO: Scrape type for GF05972: 0
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: JR97776
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR97776%27 HTTP/1.1" 200 None
2026-03-28 21:06:40 [auto1.it] INFO: Scrape type for JR97776: 0
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: BE98404
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: KF31033
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF31033%27 HTTP/1.1" 200 None
2026-03-28 21:06:40 [auto1.it] INFO: Scrape type for KF31033: 0
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: FF48098
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: YW01927
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: FT76605
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT76605%27 HTTP/1.1" 200 None
2026-03-28 21:06:40 [auto1.it] INFO: Scrape type for FT76605: 0
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: JY35916
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY35916%27 HTTP/1.1" 200 None
2026-03-28 21:06:40 [auto1.it] INFO: Scrape type for JY35916: 0
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: JA46265
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA46265%27 HTTP/1.1" 200 None
2026-03-28 21:06:40 [auto1.it] INFO: Scrape type for JA46265: 0
2026-03-28 21:06:40 [auto1.it] INFO: Found listing with ID: GD10861
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD10861%27 HTTP/1.1" 200 None
2026-03-28 21:06:40 [auto1.it] INFO: Scrape type for GD10861: 2
2026-03-28 21:06:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61ad1838-e2e7-5cbc-99fc-1630658d57fb with identifier: GD10861
2026-03-28 21:06:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61ad1838-e2e7-5cbc-99fc-1630658d57fb with scrape type 2
2026-03-28 21:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61ad1838-e2e7-5cbc-99fc-1630658d57fb with scrape type 2
2026-03-28 21:06:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 61ad1838-e2e7-5cbc-99fc-1630658d57fb, identifier: GD10861
2026-03-28 21:06:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 61ad1838-e2e7-5cbc-99fc-1630658d57fb with identifier: GD10861
2026-03-28 21:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 61ad1838-e2e7-5cbc-99fc-1630658d57fb with identifier: GD10861
2026-03-28 21:06:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 61ad1838-e2e7-5cbc-99fc-1630658d57fb with identifier: GD10861 to the API
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:03:15Z',
'fuel_type': 'petrol',
'id': '61ad1838-e2e7-5cbc-99fc-1630658d57fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD10861',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 42795,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-10-26',
'seller_name': None,
'title': 'Fiat Panda 1.2 Dynamic',
'transmission': 'manual',
'trim': 'Dynamic',
'year': 2005}
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD10861%27 HTTP/1.1" 200 None
2026-03-28 21:06:41 [auto1.it] INFO: Saving data for GD10861: {'auction_closing_time': 1774882995.0, 'created_time': 1774533976.046886, 'last_price_update_time': 1774732001.438743}
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GD10861') HTTP/1.1" 204 0
2026-03-28 21:06:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:41 [auto1.it] INFO: Found listing with ID: DN99534
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DN99534%27 HTTP/1.1" 200 None
2026-03-28 21:06:41 [auto1.it] INFO: Scrape type for DN99534: 0
2026-03-28 21:06:41 [auto1.it] INFO: Found listing with ID: ET57280
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET57280%27 HTTP/1.1" 200 None
2026-03-28 21:06:41 [auto1.it] INFO: Scrape type for ET57280: 0
2026-03-28 21:06:41 [auto1.it] INFO: Found listing with ID: YU33914
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU33914%27 HTTP/1.1" 200 None
2026-03-28 21:06:41 [auto1.it] INFO: Scrape type for YU33914: 0
2026-03-28 21:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TW16481> (referer: https://www.auto1.com/v1/car-details-view/TW16481/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9402f2e0-b14a-5306-8058-8ae610270797 with identifier: TW16481
2026-03-28 21:06:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9402f2e0-b14a-5306-8058-8ae610270797 with scrape type 1
2026-03-28 21:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9402f2e0-b14a-5306-8058-8ae610270797
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F81%252F6b81fd1c6271e4eee7c1f1afcec21a21%252Fpa%252FTW16481_039ff4acba2a747f52d77cd2e2eacda6.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_039ff4acba2a747f52d77cd2e2eacda6.jpg already downloaded
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F81%252F6b81fd1c6271e4eee7c1f1afcec21a21%252Fpa%252FTW16481_a2c233914adfb0956269d67b30918262.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_a2c233914adfb0956269d67b30918262.jpg already downloaded
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F81%252F6b81fd1c6271e4eee7c1f1afcec21a21%252Fpa%252FTW16481_cb0cb846adead87607bfb4227a110cd9.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_cb0cb846adead87607bfb4227a110cd9.jpg already downloaded
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F81%252F6b81fd1c6271e4eee7c1f1afcec21a21%252Fpa%252FTW16481_1b57647243de4d972bf3fb12fc65553f.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_1b57647243de4d972bf3fb12fc65553f.jpg already downloaded
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F81%252F6b81fd1c6271e4eee7c1f1afcec21a21%252Fpa%252FTW16481_98dbfe20aed3512458118834c0d040bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_98dbfe20aed3512458118834c0d040bf.jpg already downloaded
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F81%252F6b81fd1c6271e4eee7c1f1afcec21a21%252Fpa%252FTW16481_f696eaadae41b468acb08ba6ae7e2f25.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_f696eaadae41b468acb08ba6ae7e2f25.jpg already downloaded
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F81%252F6b81fd1c6271e4eee7c1f1afcec21a21%252Fpa%252FTW16481_49d934b3dd7f7b420c35596f70a1d090.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_49d934b3dd7f7b420c35596f70a1d090.jpg already downloaded
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F81%252F6b81fd1c6271e4eee7c1f1afcec21a21%252Fpa%252FTW16481_c75d55ac5a965f7917a6953623695884.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_c75d55ac5a965f7917a6953623695884.jpg already downloaded
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F81%252F6b81fd1c6271e4eee7c1f1afcec21a21%252Fpa%252FTW16481_c61e032e0bd5da45a7d917a4b6bcbce3.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_c61e032e0bd5da45a7d917a4b6bcbce3.jpg already downloaded
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F81%252F6b81fd1c6271e4eee7c1f1afcec21a21%252Fpa%252FTW16481_0fe038388da927b800d9a97a0d108aed.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_0fe038388da927b800d9a97a0d108aed.jpg already downloaded
2026-03-28 21:06:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9402f2e0-b14a-5306-8058-8ae610270797, identifier: TW16481
2026-03-28 21:06:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9402f2e0-b14a-5306-8058-8ae610270797 with identifier: TW16481
2026-03-28 21:06:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9402f2e0-b14a-5306-8058-8ae610270797 with identifier: TW16481
2026-03-28 21:06:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9402f2e0-b14a-5306-8058-8ae610270797 with identifier: TW16481 to the API
2026-03-28 21:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TW16481>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine': '2.0L',
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:02:29Z',
'fuel_type': 'diesel',
'id': '9402f2e0-b14a-5306-8058-8ae610270797',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW16481',
'listing': 'auction',
'location': 'IT, Padova',
'make': 'Peugeot',
'model': 'RCZ',
'odometer': 195860,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_039ff4acba2a747f52d77cd2e2eacda6.jpg',
'https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_a2c233914adfb0956269d67b30918262.jpg',
'https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_cb0cb846adead87607bfb4227a110cd9.jpg',
'https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_1b57647243de4d972bf3fb12fc65553f.jpg',
'https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_98dbfe20aed3512458118834c0d040bf.jpg',
'https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_f696eaadae41b468acb08ba6ae7e2f25.jpg',
'https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_49d934b3dd7f7b420c35596f70a1d090.jpg',
'https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_c75d55ac5a965f7917a6953623695884.jpg',
'https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_c61e032e0bd5da45a7d917a4b6bcbce3.jpg',
'https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_0fe038388da927b800d9a97a0d108aed.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9402f2e0-b14a-5306-8058-8ae610270797/9402f2e0-b14a-5306-8058-8ae610270797_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3146947,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_039ff4acba2a747f52d77cd2e2eacda6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9402f2e0-b14a-5306-8058-8ae610270797/9402f2e0-b14a-5306-8058-8ae610270797_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86256,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_a2c233914adfb0956269d67b30918262.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9402f2e0-b14a-5306-8058-8ae610270797/9402f2e0-b14a-5306-8058-8ae610270797_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2384860,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_cb0cb846adead87607bfb4227a110cd9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9402f2e0-b14a-5306-8058-8ae610270797/9402f2e0-b14a-5306-8058-8ae610270797_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2551640,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_1b57647243de4d972bf3fb12fc65553f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9402f2e0-b14a-5306-8058-8ae610270797/9402f2e0-b14a-5306-8058-8ae610270797_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2314872,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_98dbfe20aed3512458118834c0d040bf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9402f2e0-b14a-5306-8058-8ae610270797/9402f2e0-b14a-5306-8058-8ae610270797_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88056,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_f696eaadae41b468acb08ba6ae7e2f25.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9402f2e0-b14a-5306-8058-8ae610270797/9402f2e0-b14a-5306-8058-8ae610270797_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2341230,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_49d934b3dd7f7b420c35596f70a1d090.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9402f2e0-b14a-5306-8058-8ae610270797/9402f2e0-b14a-5306-8058-8ae610270797_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84148,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_c75d55ac5a965f7917a6953623695884.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9402f2e0-b14a-5306-8058-8ae610270797/9402f2e0-b14a-5306-8058-8ae610270797_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87856,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_c61e032e0bd5da45a7d917a4b6bcbce3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9402f2e0-b14a-5306-8058-8ae610270797/9402f2e0-b14a-5306-8058-8ae610270797_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64559,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/81/6b81fd1c6271e4eee7c1f1afcec21a21/pa/TW16481_0fe038388da927b800d9a97a0d108aed.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-08-29',
'seats_number': 4,
'seller_name': None,
'title': 'Peugeot RCZ 2.0 HDi Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2013}
2026-03-28 21:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TW16481%27 HTTP/1.1" 200 None
2026-03-28 21:06:42 [auto1.it] INFO: Saving data for TW16481: {'created_time': 1774732002.376688, 'last_price_update_time': 1774732002.376698, 'auction_closing_time': 1774882949.0}
2026-03-28 21:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TW16481') HTTP/1.1" 204 0
2026-03-28 21:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:43 [auto1.it] INFO: Channel: 24h | Page: 28 | totalHits: 2224 | hits on page: 40
2026-03-28 21:06:43 [auto1.it] INFO: Found listing with ID: BM81624
2026-03-28 21:06:43 [auto1.it] INFO: Found listing with ID: XJ23148
2026-03-28 21:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ23148%27 HTTP/1.1" 200 None
2026-03-28 21:06:43 [auto1.it] INFO: Scrape type for XJ23148: 0
2026-03-28 21:06:43 [auto1.it] INFO: Found listing with ID: WF71586
2026-03-28 21:06:43 [auto1.it] INFO: Found listing with ID: PT53216
2026-03-28 21:06:43 [auto1.it] INFO: Found listing with ID: GC53002
2026-03-28 21:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC53002%27 HTTP/1.1" 200 None
2026-03-28 21:06:43 [auto1.it] INFO: Scrape type for GC53002: 0
2026-03-28 21:06:43 [auto1.it] INFO: Found listing with ID: AZ52753
2026-03-28 21:06:43 [auto1.it] INFO: Found listing with ID: GJ43112
2026-03-28 21:06:43 [auto1.it] INFO: Found listing with ID: CT25036
2026-03-28 21:06:43 [auto1.it] INFO: Found listing with ID: FZ67880
2026-03-28 21:06:43 [auto1.it] INFO: Found listing with ID: GA58857
2026-03-28 21:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA58857%27 HTTP/1.1" 200 None
2026-03-28 21:06:43 [auto1.it] INFO: Scrape type for GA58857: 0
2026-03-28 21:06:43 [auto1.it] INFO: Found listing with ID: VY96828
2026-03-28 21:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY96828%27 HTTP/1.1" 200 None
2026-03-28 21:06:43 [auto1.it] INFO: Scrape type for VY96828: 0
2026-03-28 21:06:43 [auto1.it] INFO: Found listing with ID: AN61279
2026-03-28 21:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN61279%27 HTTP/1.1" 200 None
2026-03-28 21:06:43 [auto1.it] INFO: Scrape type for AN61279: 2
2026-03-28 21:06:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2bda1dc-9e42-5b3b-aa17-a6cab321a0ec with identifier: AN61279
2026-03-28 21:06:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2bda1dc-9e42-5b3b-aa17-a6cab321a0ec with scrape type 2
2026-03-28 21:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2bda1dc-9e42-5b3b-aa17-a6cab321a0ec with scrape type 2
2026-03-28 21:06:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c2bda1dc-9e42-5b3b-aa17-a6cab321a0ec, identifier: AN61279
2026-03-28 21:06:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c2bda1dc-9e42-5b3b-aa17-a6cab321a0ec with identifier: AN61279
2026-03-28 21:06:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c2bda1dc-9e42-5b3b-aa17-a6cab321a0ec with identifier: AN61279
2026-03-28 21:06:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c2bda1dc-9e42-5b3b-aa17-a6cab321a0ec with identifier: AN61279 to the API
2026-03-28 21:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:43:36Z',
'fuel_type': 'petrol',
'id': 'c2bda1dc-9e42-5b3b-aa17-a6cab321a0ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN61279',
'listing': 'auction',
'make': 'Ford',
'model': 'Puma',
'odometer': 17579,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-14',
'seller_name': None,
'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2023}
2026-03-28 21:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN61279%27 HTTP/1.1" 200 None
2026-03-28 21:06:43 [auto1.it] INFO: Saving data for AN61279: {'auction_closing_time': 1774885416.0, 'created_time': 1773134782.851542, 'last_price_update_time': 1774732003.845611}
2026-03-28 21:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AN61279') HTTP/1.1" 204 0
2026-03-28 21:06:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:43 [auto1.it] INFO: Found listing with ID: GX83807
2026-03-28 21:06:43 [auto1.it] INFO: Found listing with ID: FL80724
2026-03-28 21:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL80724%27 HTTP/1.1" 200 None
2026-03-28 21:06:43 [auto1.it] INFO: Scrape type for FL80724: 0
2026-03-28 21:06:43 [auto1.it] INFO: Found listing with ID: ZT64017
2026-03-28 21:06:43 [auto1.it] INFO: Found listing with ID: YL77107
2026-03-28 21:06:43 [auto1.it] INFO: Found listing with ID: AB97936
2026-03-28 21:06:43 [auto1.it] INFO: Found listing with ID: UW31013
2026-03-28 21:06:44 [auto1.it] INFO: Found listing with ID: SN78206
2026-03-28 21:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN78206%27 HTTP/1.1" 200 None
2026-03-28 21:06:44 [auto1.it] INFO: Scrape type for SN78206: 0
2026-03-28 21:06:44 [auto1.it] INFO: Found listing with ID: DD38287
2026-03-28 21:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD38287%27 HTTP/1.1" 200 None
2026-03-28 21:06:44 [auto1.it] INFO: Scrape type for DD38287: 0
2026-03-28 21:06:44 [auto1.it] INFO: Found listing with ID: AN14799
2026-03-28 21:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN14799%27 HTTP/1.1" 200 None
2026-03-28 21:06:44 [auto1.it] INFO: Scrape type for AN14799: 1
2026-03-28 21:06:44 [auto1.it] INFO: Found listing with ID: UL06285
2026-03-28 21:06:44 [auto1.it] INFO: Found listing with ID: HG91847
2026-03-28 21:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG91847%27 HTTP/1.1" 200 None
2026-03-28 21:06:44 [auto1.it] INFO: Scrape type for HG91847: 0
2026-03-28 21:06:44 [auto1.it] INFO: Found listing with ID: NW69655
2026-03-28 21:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW69655%27 HTTP/1.1" 200 None
2026-03-28 21:06:44 [auto1.it] INFO: Scrape type for NW69655: 0
2026-03-28 21:06:44 [auto1.it] INFO: Found listing with ID: ER04044
2026-03-28 21:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER04044%27 HTTP/1.1" 200 None
2026-03-28 21:06:44 [auto1.it] INFO: Scrape type for ER04044: 0
2026-03-28 21:06:44 [auto1.it] INFO: Found listing with ID: BJ95013
2026-03-28 21:06:44 [auto1.it] INFO: Found listing with ID: AH48855
2026-03-28 21:06:44 [auto1.it] INFO: Found listing with ID: EX06757
2026-03-28 21:06:44 [auto1.it] INFO: Found listing with ID: WW83170
2026-03-28 21:06:44 [auto1.it] INFO: Found listing with ID: HR62667
2026-03-28 21:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR62667%27 HTTP/1.1" 200 None
2026-03-28 21:06:44 [auto1.it] INFO: Scrape type for HR62667: 0
2026-03-28 21:06:44 [auto1.it] INFO: Found listing with ID: ZG86392
2026-03-28 21:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZG86392%27 HTTP/1.1" 200 None
2026-03-28 21:06:44 [auto1.it] INFO: Scrape type for ZG86392: 0
2026-03-28 21:06:44 [auto1.it] INFO: Found listing with ID: TN35413
2026-03-28 21:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TN35413%27 HTTP/1.1" 200 None
2026-03-28 21:06:44 [auto1.it] INFO: Scrape type for TN35413: 2
2026-03-28 21:06:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0654b428-d1ab-55a6-bff7-ae3326d12fb9 with identifier: TN35413
2026-03-28 21:06:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0654b428-d1ab-55a6-bff7-ae3326d12fb9 with scrape type 2
2026-03-28 21:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0654b428-d1ab-55a6-bff7-ae3326d12fb9 with scrape type 2
2026-03-28 21:06:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0654b428-d1ab-55a6-bff7-ae3326d12fb9, identifier: TN35413
2026-03-28 21:06:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0654b428-d1ab-55a6-bff7-ae3326d12fb9 with identifier: TN35413
2026-03-28 21:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0654b428-d1ab-55a6-bff7-ae3326d12fb9 with identifier: TN35413
2026-03-28 21:06:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0654b428-d1ab-55a6-bff7-ae3326d12fb9 with identifier: TN35413 to the API
2026-03-28 21:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:40:59Z',
'fuel_type': 'diesel',
'id': '0654b428-d1ab-55a6-bff7-ae3326d12fb9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN35413',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 189024,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-26',
'seller_name': None,
'title': 'BMW X5 xDrive 25d',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-28 21:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TN35413%27 HTTP/1.1" 200 None
2026-03-28 21:06:44 [auto1.it] INFO: Saving data for TN35413: {'auction_closing_time': 1774885259.0, 'created_time': 1774533992.048374, 'last_price_update_time': 1774732004.647121}
2026-03-28 21:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TN35413') HTTP/1.1" 204 0
2026-03-28 21:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:44 [auto1.it] INFO: Found listing with ID: BJ71456
2026-03-28 21:06:44 [auto1.it] INFO: Found listing with ID: PH76883
2026-03-28 21:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH76883%27 HTTP/1.1" 200 None
2026-03-28 21:06:44 [auto1.it] INFO: Scrape type for PH76883: 0
2026-03-28 21:06:44 [auto1.it] INFO: Found listing with ID: YB89619
2026-03-28 21:06:44 [auto1.it] INFO: Found listing with ID: RB12034
2026-03-28 21:06:44 [auto1.it] INFO: Found listing with ID: MJ42614
2026-03-28 21:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ42614%27 HTTP/1.1" 200 None
2026-03-28 21:06:44 [auto1.it] INFO: Scrape type for MJ42614: 2
2026-03-28 21:06:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60ae398f-e974-5d88-becd-4b2f3809f826 with identifier: MJ42614
2026-03-28 21:06:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60ae398f-e974-5d88-becd-4b2f3809f826 with scrape type 2
2026-03-28 21:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60ae398f-e974-5d88-becd-4b2f3809f826 with scrape type 2
2026-03-28 21:06:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 60ae398f-e974-5d88-becd-4b2f3809f826, identifier: MJ42614
2026-03-28 21:06:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 60ae398f-e974-5d88-becd-4b2f3809f826 with identifier: MJ42614
2026-03-28 21:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 60ae398f-e974-5d88-becd-4b2f3809f826 with identifier: MJ42614
2026-03-28 21:06:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 60ae398f-e974-5d88-becd-4b2f3809f826 with identifier: MJ42614 to the API
2026-03-28 21:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:20:23Z',
'fuel_type': 'petrol',
'id': '60ae398f-e974-5d88-becd-4b2f3809f826',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ42614',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Cross',
'odometer': 14260,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-28',
'seller_name': None,
'title': 'Volkswagen T-Cross 1.0 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2024}
2026-03-28 21:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ42614%27 HTTP/1.1" 200 None
2026-03-28 21:06:45 [auto1.it] INFO: Saving data for MJ42614: {'auction_closing_time': 1774884023.0, 'created_time': 1774533987.781528, 'last_price_update_time': 1774732005.196727}
2026-03-28 21:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MJ42614') HTTP/1.1" 204 0
2026-03-28 21:06:45 [auto1.it] INFO: Found listing with ID: PZ52639
2026-03-28 21:06:45 [auto1.it] INFO: Found listing with ID: UA37690
2026-03-28 21:06:45 [auto1.it] INFO: Found listing with ID: PZ93737
2026-03-28 21:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ93737%27 HTTP/1.1" 200 None
2026-03-28 21:06:45 [auto1.it] INFO: Scrape type for PZ93737: 0
2026-03-28 21:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AN14799/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:46 [auto1.it] INFO: Channel: 24h | Page: 29 | totalHits: 2224 | hits on page: 40
2026-03-28 21:06:46 [auto1.it] INFO: Found listing with ID: ED77139
2026-03-28 21:06:46 [auto1.it] INFO: Found listing with ID: RM13688
2026-03-28 21:06:46 [auto1.it] INFO: Found listing with ID: FF45161
2026-03-28 21:06:46 [auto1.it] INFO: Found listing with ID: KU06425
2026-03-28 21:06:46 [auto1.it] INFO: Found listing with ID: ZL07806
2026-03-28 21:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL07806%27 HTTP/1.1" 200 None
2026-03-28 21:06:46 [auto1.it] INFO: Scrape type for ZL07806: 0
2026-03-28 21:06:46 [auto1.it] INFO: Found listing with ID: GV49335
2026-03-28 21:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV49335%27 HTTP/1.1" 200 None
2026-03-28 21:06:46 [auto1.it] INFO: Scrape type for GV49335: 0
2026-03-28 21:06:46 [auto1.it] INFO: Found listing with ID: XG74352
2026-03-28 21:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XG74352%27 HTTP/1.1" 200 None
2026-03-28 21:06:46 [auto1.it] INFO: Scrape type for XG74352: 0
2026-03-28 21:06:46 [auto1.it] INFO: Found listing with ID: JV69341
2026-03-28 21:06:46 [auto1.it] INFO: Found listing with ID: AZ64167
2026-03-28 21:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ64167%27 HTTP/1.1" 200 None
2026-03-28 21:06:46 [auto1.it] INFO: Scrape type for AZ64167: 0
2026-03-28 21:06:46 [auto1.it] INFO: Found listing with ID: JR54731
2026-03-28 21:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR54731%27 HTTP/1.1" 200 None
2026-03-28 21:06:46 [auto1.it] INFO: Scrape type for JR54731: 0
2026-03-28 21:06:46 [auto1.it] INFO: Found listing with ID: BD88975
2026-03-28 21:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD88975%27 HTTP/1.1" 200 None
2026-03-28 21:06:46 [auto1.it] INFO: Scrape type for BD88975: 2
2026-03-28 21:06:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a568ed3c-ebf4-50e1-b651-1441e2d37997 with identifier: BD88975
2026-03-28 21:06:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a568ed3c-ebf4-50e1-b651-1441e2d37997 with scrape type 2
2026-03-28 21:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a568ed3c-ebf4-50e1-b651-1441e2d37997 with scrape type 2
2026-03-28 21:06:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a568ed3c-ebf4-50e1-b651-1441e2d37997, identifier: BD88975
2026-03-28 21:06:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a568ed3c-ebf4-50e1-b651-1441e2d37997 with identifier: BD88975
2026-03-28 21:06:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a568ed3c-ebf4-50e1-b651-1441e2d37997 with identifier: BD88975
2026-03-28 21:06:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a568ed3c-ebf4-50e1-b651-1441e2d37997 with identifier: BD88975 to the API
2026-03-28 21:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:52:03Z',
'fuel_type': 'diesel',
'id': 'a568ed3c-ebf4-50e1-b651-1441e2d37997',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD88975',
'listing': 'auction',
'make': 'Jaguar',
'model': 'F-Pace',
'odometer': 209520,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-06',
'seller_name': None,
'title': 'Jaguar F-Pace 20d Portfolio AWD',
'transmission': 'automatic',
'trim': 'Portfolio AWD',
'year': 2018}
2026-03-28 21:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD88975%27 HTTP/1.1" 200 None
2026-03-28 21:06:46 [auto1.it] INFO: Saving data for BD88975: {'auction_closing_time': 1774885923.0, 'created_time': 1772623874.769767, 'last_price_update_time': 1774732006.831159}
2026-03-28 21:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BD88975') HTTP/1.1" 204 0
2026-03-28 21:06:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:46 [auto1.it] INFO: Found listing with ID: EH51725
2026-03-28 21:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH51725%27 HTTP/1.1" 200 None
2026-03-28 21:06:46 [auto1.it] INFO: Scrape type for EH51725: 2
2026-03-28 21:06:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe3c11f7-f99e-5330-b268-58c272f57293 with identifier: EH51725
2026-03-28 21:06:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe3c11f7-f99e-5330-b268-58c272f57293 with scrape type 2
2026-03-28 21:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe3c11f7-f99e-5330-b268-58c272f57293 with scrape type 2
2026-03-28 21:06:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fe3c11f7-f99e-5330-b268-58c272f57293, identifier: EH51725
2026-03-28 21:06:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fe3c11f7-f99e-5330-b268-58c272f57293 with identifier: EH51725
2026-03-28 21:06:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fe3c11f7-f99e-5330-b268-58c272f57293 with identifier: EH51725
2026-03-28 21:06:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fe3c11f7-f99e-5330-b268-58c272f57293 with identifier: EH51725 to the API
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:05:31Z',
'fuel_type': 'diesel',
'id': 'fe3c11f7-f99e-5330-b268-58c272f57293',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH51725',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 213376,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-01',
'seller_name': None,
'title': 'BMW 2er 218d Gran Tourer Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2016}
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH51725%27 HTTP/1.1" 200 None
2026-03-28 21:06:47 [auto1.it] INFO: Saving data for EH51725: {'auction_closing_time': 1774883131.0, 'created_time': 1773130860.043426, 'last_price_update_time': 1774732007.365276}
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EH51725') HTTP/1.1" 204 0
2026-03-28 21:06:47 [auto1.it] INFO: Found listing with ID: SK38422
2026-03-28 21:06:47 [auto1.it] INFO: Found listing with ID: YW35893
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW35893%27 HTTP/1.1" 200 None
2026-03-28 21:06:47 [auto1.it] INFO: Scrape type for YW35893: 0
2026-03-28 21:06:47 [auto1.it] INFO: Found listing with ID: TG42626
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TG42626%27 HTTP/1.1" 200 None
2026-03-28 21:06:47 [auto1.it] INFO: Scrape type for TG42626: 0
2026-03-28 21:06:47 [auto1.it] INFO: Found listing with ID: WN42286
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN42286%27 HTTP/1.1" 200 None
2026-03-28 21:06:47 [auto1.it] INFO: Scrape type for WN42286: 0
2026-03-28 21:06:47 [auto1.it] INFO: Found listing with ID: MP39083
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP39083%27 HTTP/1.1" 200 None
2026-03-28 21:06:47 [auto1.it] INFO: Scrape type for MP39083: 0
2026-03-28 21:06:47 [auto1.it] INFO: Found listing with ID: XB00155
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB00155%27 HTTP/1.1" 200 None
2026-03-28 21:06:47 [auto1.it] INFO: Scrape type for XB00155: 0
2026-03-28 21:06:47 [auto1.it] INFO: Found listing with ID: UZ24825
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ24825%27 HTTP/1.1" 200 None
2026-03-28 21:06:47 [auto1.it] INFO: Scrape type for UZ24825: 0
2026-03-28 21:06:47 [auto1.it] INFO: Found listing with ID: XX37698
2026-03-28 21:06:47 [auto1.it] INFO: Found listing with ID: PL52224
2026-03-28 21:06:47 [auto1.it] INFO: Found listing with ID: DU17366
2026-03-28 21:06:47 [auto1.it] INFO: Found listing with ID: YG69242
2026-03-28 21:06:47 [auto1.it] INFO: Found listing with ID: WT33776
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT33776%27 HTTP/1.1" 200 None
2026-03-28 21:06:47 [auto1.it] INFO: Scrape type for WT33776: 0
2026-03-28 21:06:47 [auto1.it] INFO: Found listing with ID: JH67201
2026-03-28 21:06:47 [auto1.it] INFO: Found listing with ID: JU08968
2026-03-28 21:06:47 [auto1.it] INFO: Found listing with ID: RG08940
2026-03-28 21:06:47 [auto1.it] INFO: Found listing with ID: PM46324
2026-03-28 21:06:47 [auto1.it] INFO: Found listing with ID: NP16593
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP16593%27 HTTP/1.1" 200 None
2026-03-28 21:06:47 [auto1.it] INFO: Scrape type for NP16593: 0
2026-03-28 21:06:47 [auto1.it] INFO: Found listing with ID: KZ30481
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ30481%27 HTTP/1.1" 200 None
2026-03-28 21:06:47 [auto1.it] INFO: Scrape type for KZ30481: 0
2026-03-28 21:06:47 [auto1.it] INFO: Found listing with ID: RS22306
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS22306%27 HTTP/1.1" 200 None
2026-03-28 21:06:47 [auto1.it] INFO: Scrape type for RS22306: 0
2026-03-28 21:06:47 [auto1.it] INFO: Found listing with ID: JD45338
2026-03-28 21:06:47 [auto1.it] INFO: Found listing with ID: RU70753
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU70753%27 HTTP/1.1" 200 None
2026-03-28 21:06:47 [auto1.it] INFO: Scrape type for RU70753: 0
2026-03-28 21:06:47 [auto1.it] INFO: Found listing with ID: AW98600
2026-03-28 21:06:47 [auto1.it] INFO: Found listing with ID: JT23346
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JT23346%27 HTTP/1.1" 200 None
2026-03-28 21:06:47 [auto1.it] INFO: Scrape type for JT23346: 0
2026-03-28 21:06:47 [auto1.it] INFO: Found listing with ID: ZC00549
2026-03-28 21:06:47 [auto1.it] INFO: Found listing with ID: RB23819
2026-03-28 21:06:47 [auto1.it] INFO: Found listing with ID: KB15233
2026-03-28 21:06:47 [auto1.it] INFO: Found listing with ID: TJ20772
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ20772%27 HTTP/1.1" 200 None
2026-03-28 21:06:47 [auto1.it] INFO: Scrape type for TJ20772: 0
2026-03-28 21:06:47 [auto1.it] INFO: Found listing with ID: ML96661
2026-03-28 21:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AN14799> (referer: https://www.auto1.com/v1/car-details-view/AN14799/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:48 [auto1.it] INFO: Channel: 24h | Page: 30 | totalHits: 2224 | hits on page: 40
2026-03-28 21:06:48 [auto1.it] INFO: Found listing with ID: AR12639
2026-03-28 21:06:48 [auto1.it] INFO: Found listing with ID: JM76846
2026-03-28 21:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM76846%27 HTTP/1.1" 200 None
2026-03-28 21:06:48 [auto1.it] INFO: Scrape type for JM76846: 2
2026-03-28 21:06:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b18e2c8-f97d-578e-84c2-9cdecc90eadd with identifier: JM76846
2026-03-28 21:06:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b18e2c8-f97d-578e-84c2-9cdecc90eadd with scrape type 2
2026-03-28 21:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b18e2c8-f97d-578e-84c2-9cdecc90eadd with scrape type 2
2026-03-28 21:06:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5b18e2c8-f97d-578e-84c2-9cdecc90eadd, identifier: JM76846
2026-03-28 21:06:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5b18e2c8-f97d-578e-84c2-9cdecc90eadd with identifier: JM76846
2026-03-28 21:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5b18e2c8-f97d-578e-84c2-9cdecc90eadd with identifier: JM76846
2026-03-28 21:06:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5b18e2c8-f97d-578e-84c2-9cdecc90eadd with identifier: JM76846 to the API
2026-03-28 21:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 220,
'expiration_date': '2026-03-30T15:39:02Z',
'fuel_type': 'diesel',
'id': '5b18e2c8-f97d-578e-84c2-9cdecc90eadd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM76846',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 66350,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-04',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d Mild-Hybrid T AMG Line',
'transmission': 'automatic',
'trim': 'T AMG Line',
'year': 2022}
2026-03-28 21:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM76846%27 HTTP/1.1" 200 None
2026-03-28 21:06:49 [auto1.it] INFO: Saving data for JM76846: {'auction_closing_time': 1774885142.0, 'created_time': 1774533974.477074, 'last_price_update_time': 1774732009.03152}
2026-03-28 21:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JM76846') HTTP/1.1" 204 0
2026-03-28 21:06:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c86e6b7f-d3dc-5123-8630-7b67f9d5c51e with identifier: AN14799
2026-03-28 21:06:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c86e6b7f-d3dc-5123-8630-7b67f9d5c51e with scrape type 1
2026-03-28 21:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item c86e6b7f-d3dc-5123-8630-7b67f9d5c51e
2026-03-28 21:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F4b%252Fcf4be5d0ee985072ae007c8d3fdc782c%252Fpa%252FAN14799_21f28c39da3fa627068ba73131a8d89c.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/4b/cf4be5d0ee985072ae007c8d3fdc782c/pa/AN14799_21f28c39da3fa627068ba73131a8d89c.jpg already downloaded
2026-03-28 21:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F4b%252Fcf4be5d0ee985072ae007c8d3fdc782c%252Fpa%252FAN14799_b841d04272d1e231a138008a732b2c9d.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/4b/cf4be5d0ee985072ae007c8d3fdc782c/pa/AN14799_b841d04272d1e231a138008a732b2c9d.jpg already downloaded
2026-03-28 21:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F4b%252Fcf4be5d0ee985072ae007c8d3fdc782c%252Fpa%252FAN14799_bde2966f5ae6c021f2e1abc02d3895f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/4b/cf4be5d0ee985072ae007c8d3fdc782c/pa/AN14799_bde2966f5ae6c021f2e1abc02d3895f5.jpg already downloaded
2026-03-28 21:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F4b%252Fcf4be5d0ee985072ae007c8d3fdc782c%252Fpa%252FAN14799_ef6d173e086f1c0952fa71c564bf75fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/4b/cf4be5d0ee985072ae007c8d3fdc782c/pa/AN14799_ef6d173e086f1c0952fa71c564bf75fb.jpg already downloaded
2026-03-28 21:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F4b%252Fcf4be5d0ee985072ae007c8d3fdc782c%252Fpa%252FAN14799_5fc106311edfcf576b3a400948b55cf3.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/4b/cf4be5d0ee985072ae007c8d3fdc782c/pa/AN14799_5fc106311edfcf576b3a400948b55cf3.jpg already downloaded
2026-03-28 21:06:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c86e6b7f-d3dc-5123-8630-7b67f9d5c51e, identifier: AN14799
2026-03-28 21:06:49 [auto1.it] INFO: Found listing with ID: DX27899
2026-03-28 21:06:49 [auto1.it] INFO: Found listing with ID: UT67830
2026-03-28 21:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT67830%27 HTTP/1.1" 200 None
2026-03-28 21:06:49 [auto1.it] INFO: Scrape type for UT67830: 2
2026-03-28 21:06:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab323e3a-53b5-5eb1-b5f6-af6090ef68a7 with identifier: UT67830
2026-03-28 21:06:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab323e3a-53b5-5eb1-b5f6-af6090ef68a7 with scrape type 2
2026-03-28 21:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab323e3a-53b5-5eb1-b5f6-af6090ef68a7 with scrape type 2
2026-03-28 21:06:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ab323e3a-53b5-5eb1-b5f6-af6090ef68a7, identifier: UT67830
2026-03-28 21:06:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c86e6b7f-d3dc-5123-8630-7b67f9d5c51e with identifier: AN14799
2026-03-28 21:06:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c86e6b7f-d3dc-5123-8630-7b67f9d5c51e with identifier: AN14799
2026-03-28 21:06:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c86e6b7f-d3dc-5123-8630-7b67f9d5c51e with identifier: AN14799 to the API
2026-03-28 21:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AN14799>
{'auction_title': '',
'c_o_2_emission_value': 163,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 2',
'engine': '1.3L',
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:04:48Z',
'fuel_type': 'petrol',
'id': 'c86e6b7f-d3dc-5123-8630-7b67f9d5c51e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN14799',
'listing': 'auction',
'location': 'IT, Caltanissetta',
'make': 'Ford',
'model': 'Ka',
'odometer': 89294,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/imgcf/4b/cf4be5d0ee985072ae007c8d3fdc782c/pa/AN14799_21f28c39da3fa627068ba73131a8d89c.jpg',
'https://img-pa.auto1.com/imgcf/4b/cf4be5d0ee985072ae007c8d3fdc782c/pa/AN14799_b841d04272d1e231a138008a732b2c9d.jpg',
'https://img-pa.auto1.com/imgcf/4b/cf4be5d0ee985072ae007c8d3fdc782c/pa/AN14799_bde2966f5ae6c021f2e1abc02d3895f5.jpg',
'https://img-pa.auto1.com/imgcf/4b/cf4be5d0ee985072ae007c8d3fdc782c/pa/AN14799_ef6d173e086f1c0952fa71c564bf75fb.jpg',
'https://img-pa.auto1.com/imgcf/4b/cf4be5d0ee985072ae007c8d3fdc782c/pa/AN14799_5fc106311edfcf576b3a400948b55cf3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c86e6b7f-d3dc-5123-8630-7b67f9d5c51e/c86e6b7f-d3dc-5123-8630-7b67f9d5c51e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115571,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/4b/cf4be5d0ee985072ae007c8d3fdc782c/pa/AN14799_21f28c39da3fa627068ba73131a8d89c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c86e6b7f-d3dc-5123-8630-7b67f9d5c51e/c86e6b7f-d3dc-5123-8630-7b67f9d5c51e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125023,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/4b/cf4be5d0ee985072ae007c8d3fdc782c/pa/AN14799_b841d04272d1e231a138008a732b2c9d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c86e6b7f-d3dc-5123-8630-7b67f9d5c51e/c86e6b7f-d3dc-5123-8630-7b67f9d5c51e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83181,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/4b/cf4be5d0ee985072ae007c8d3fdc782c/pa/AN14799_bde2966f5ae6c021f2e1abc02d3895f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c86e6b7f-d3dc-5123-8630-7b67f9d5c51e/c86e6b7f-d3dc-5123-8630-7b67f9d5c51e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49802,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/4b/cf4be5d0ee985072ae007c8d3fdc782c/pa/AN14799_ef6d173e086f1c0952fa71c564bf75fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c86e6b7f-d3dc-5123-8630-7b67f9d5c51e/c86e6b7f-d3dc-5123-8630-7b67f9d5c51e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38362,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcf/4b/cf4be5d0ee985072ae007c8d3fdc782c/pa/AN14799_5fc106311edfcf576b3a400948b55cf3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2000-03-15',
'seats_number': 4,
'seller_name': None,
'title': 'Ford Ka 1.3 Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2000}
2026-03-28 21:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AN14799%27 HTTP/1.1" 200 None
2026-03-28 21:06:49 [auto1.it] INFO: Saving data for AN14799: {'created_time': 1774732009.815471, 'last_price_update_time': 1774732009.815484, 'auction_closing_time': 1774883088.0}
2026-03-28 21:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AN14799') HTTP/1.1" 204 0
2026-03-28 21:06:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ab323e3a-53b5-5eb1-b5f6-af6090ef68a7 with identifier: UT67830
2026-03-28 21:06:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ab323e3a-53b5-5eb1-b5f6-af6090ef68a7 with identifier: UT67830
2026-03-28 21:06:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ab323e3a-53b5-5eb1-b5f6-af6090ef68a7 with identifier: UT67830 to the API
2026-03-28 21:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:34:30Z',
'fuel_type': 'petrol',
'id': 'ab323e3a-53b5-5eb1-b5f6-af6090ef68a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT67830',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 167880,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-18',
'seller_name': None,
'title': 'Renault Clio 1.2 YAHOO!',
'transmission': 'manual',
'trim': 'YAHOO!',
'year': 2012}
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT67830%27 HTTP/1.1" 200 None
2026-03-28 21:06:50 [auto1.it] INFO: Saving data for UT67830: {'auction_closing_time': 1774884870.0, 'created_time': 1774645601.733418, 'last_price_update_time': 1774732010.150196}
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UT67830') HTTP/1.1" 204 0
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: RU27646
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU27646%27 HTTP/1.1" 200 None
2026-03-28 21:06:50 [auto1.it] INFO: Scrape type for RU27646: 0
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: UE02945
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: XY73038
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: WM78801
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM78801%27 HTTP/1.1" 200 None
2026-03-28 21:06:50 [auto1.it] INFO: Scrape type for WM78801: 0
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: TZ26377
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ26377%27 HTTP/1.1" 200 None
2026-03-28 21:06:50 [auto1.it] INFO: Scrape type for TZ26377: 0
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: RJ37840
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ37840%27 HTTP/1.1" 200 None
2026-03-28 21:06:50 [auto1.it] INFO: Scrape type for RJ37840: 0
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: VM43481
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: HL58093
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: EG41470
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG41470%27 HTTP/1.1" 200 None
2026-03-28 21:06:50 [auto1.it] INFO: Scrape type for EG41470: 0
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: FL08980
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: ST20254
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: TZ47815
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: BB73520
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: XJ82802
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: ZM35614
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZM35614%27 HTTP/1.1" 200 None
2026-03-28 21:06:50 [auto1.it] INFO: Scrape type for ZM35614: 0
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: WK74495
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: VC06734
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VC06734%27 HTTP/1.1" 200 None
2026-03-28 21:06:50 [auto1.it] INFO: Scrape type for VC06734: 0
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: CV81447
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: YU91907
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: YY46039
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY46039%27 HTTP/1.1" 200 None
2026-03-28 21:06:50 [auto1.it] INFO: Scrape type for YY46039: 0
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: MD08971
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD08971%27 HTTP/1.1" 200 None
2026-03-28 21:06:50 [auto1.it] INFO: Scrape type for MD08971: 0
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: XN19179
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN19179%27 HTTP/1.1" 200 None
2026-03-28 21:06:50 [auto1.it] INFO: Scrape type for XN19179: 0
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: JJ50665
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ50665%27 HTTP/1.1" 200 None
2026-03-28 21:06:50 [auto1.it] INFO: Scrape type for JJ50665: 1
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: HN39146
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HN39146%27 HTTP/1.1" 200 None
2026-03-28 21:06:50 [auto1.it] INFO: Scrape type for HN39146: 0
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: MG67619
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG67619%27 HTTP/1.1" 200 None
2026-03-28 21:06:50 [auto1.it] INFO: Scrape type for MG67619: 0
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: KY69981
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KY69981%27 HTTP/1.1" 200 None
2026-03-28 21:06:50 [auto1.it] INFO: Scrape type for KY69981: 0
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: YA22905
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA22905%27 HTTP/1.1" 200 None
2026-03-28 21:06:50 [auto1.it] INFO: Scrape type for YA22905: 0
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: LK86303
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: PU63843
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PU63843%27 HTTP/1.1" 200 None
2026-03-28 21:06:50 [auto1.it] INFO: Scrape type for PU63843: 0
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: YG30728
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: SW30840
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW30840%27 HTTP/1.1" 200 None
2026-03-28 21:06:50 [auto1.it] INFO: Scrape type for SW30840: 0
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: CG66796
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: LX64348
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX64348%27 HTTP/1.1" 200 None
2026-03-28 21:06:50 [auto1.it] INFO: Scrape type for LX64348: 0
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: ZP08653
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP08653%27 HTTP/1.1" 200 None
2026-03-28 21:06:50 [auto1.it] INFO: Scrape type for ZP08653: 0
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: UK17345
2026-03-28 21:06:50 [auto1.it] INFO: Found listing with ID: WU48456
2026-03-28 21:06:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JJ50665/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:51 [auto1.it] INFO: Channel: 24h | Page: 31 | totalHits: 2224 | hits on page: 40
2026-03-28 21:06:51 [auto1.it] INFO: Found listing with ID: WW68303
2026-03-28 21:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW68303%27 HTTP/1.1" 200 None
2026-03-28 21:06:51 [auto1.it] INFO: Scrape type for WW68303: 0
2026-03-28 21:06:51 [auto1.it] INFO: Found listing with ID: LT86375
2026-03-28 21:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT86375%27 HTTP/1.1" 200 None
2026-03-28 21:06:51 [auto1.it] INFO: Scrape type for LT86375: 2
2026-03-28 21:06:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4fdd88e-c306-5064-8ade-c099b7cb6b99 with identifier: LT86375
2026-03-28 21:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4fdd88e-c306-5064-8ade-c099b7cb6b99 with scrape type 2
2026-03-28 21:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4fdd88e-c306-5064-8ade-c099b7cb6b99 with scrape type 2
2026-03-28 21:06:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a4fdd88e-c306-5064-8ade-c099b7cb6b99, identifier: LT86375
2026-03-28 21:06:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a4fdd88e-c306-5064-8ade-c099b7cb6b99 with identifier: LT86375
2026-03-28 21:06:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a4fdd88e-c306-5064-8ade-c099b7cb6b99 with identifier: LT86375
2026-03-28 21:06:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a4fdd88e-c306-5064-8ade-c099b7cb6b99 with identifier: LT86375 to the API
2026-03-28 21:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:43:46Z',
'fuel_type': 'diesel',
'id': 'a4fdd88e-c306-5064-8ade-c099b7cb6b99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT86375',
'listing': 'auction',
'make': 'Jaguar',
'model': 'F-Pace',
'odometer': 295513,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-22',
'seller_name': None,
'title': 'Jaguar F-Pace 25d Portfolio AWD',
'transmission': 'automatic',
'trim': 'Portfolio AWD',
'year': 2019}
2026-03-28 21:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT86375%27 HTTP/1.1" 200 None
2026-03-28 21:06:51 [auto1.it] INFO: Saving data for LT86375: {'auction_closing_time': 1774885426.0, 'created_time': 1773136053.452189, 'last_price_update_time': 1774732011.849093}
2026-03-28 21:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LT86375') HTTP/1.1" 204 0
2026-03-28 21:06:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:51 [auto1.it] INFO: Found listing with ID: RK63045
2026-03-28 21:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK63045%27 HTTP/1.1" 200 None
2026-03-28 21:06:51 [auto1.it] INFO: Scrape type for RK63045: 0
2026-03-28 21:06:51 [auto1.it] INFO: Found listing with ID: PG53512
2026-03-28 21:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG53512%27 HTTP/1.1" 200 None
2026-03-28 21:06:51 [auto1.it] INFO: Scrape type for PG53512: 2
2026-03-28 21:06:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4fcb06f-fea8-56f2-85b6-7ee4100ee38c with identifier: PG53512
2026-03-28 21:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4fcb06f-fea8-56f2-85b6-7ee4100ee38c with scrape type 2
2026-03-28 21:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4fcb06f-fea8-56f2-85b6-7ee4100ee38c with scrape type 2
2026-03-28 21:06:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e4fcb06f-fea8-56f2-85b6-7ee4100ee38c, identifier: PG53512
2026-03-28 21:06:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e4fcb06f-fea8-56f2-85b6-7ee4100ee38c with identifier: PG53512
2026-03-28 21:06:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e4fcb06f-fea8-56f2-85b6-7ee4100ee38c with identifier: PG53512
2026-03-28 21:06:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e4fcb06f-fea8-56f2-85b6-7ee4100ee38c with identifier: PG53512 to the API
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:36:57Z',
'fuel_type': 'diesel',
'id': 'e4fcb06f-fea8-56f2-85b6-7ee4100ee38c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG53512',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 281504,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-31',
'seller_name': None,
'title': 'Audi A3 Sportback 2.0 TDI quattro Attraction',
'transmission': 'manual',
'trim': 'quattro Attraction',
'year': 2007}
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG53512%27 HTTP/1.1" 200 None
2026-03-28 21:06:52 [auto1.it] INFO: Saving data for PG53512: {'auction_closing_time': 1774885017.0, 'created_time': 1774533975.326015, 'last_price_update_time': 1774732012.391096}
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PG53512') HTTP/1.1" 204 0
2026-03-28 21:06:52 [auto1.it] INFO: Found listing with ID: SB68054
2026-03-28 21:06:52 [auto1.it] INFO: Found listing with ID: BE98345
2026-03-28 21:06:52 [auto1.it] INFO: Found listing with ID: NF38082
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF38082%27 HTTP/1.1" 200 None
2026-03-28 21:06:52 [auto1.it] INFO: Scrape type for NF38082: 0
2026-03-28 21:06:52 [auto1.it] INFO: Found listing with ID: YB60466
2026-03-28 21:06:52 [auto1.it] INFO: Found listing with ID: RA25408
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA25408%27 HTTP/1.1" 200 None
2026-03-28 21:06:52 [auto1.it] INFO: Scrape type for RA25408: 0
2026-03-28 21:06:52 [auto1.it] INFO: Found listing with ID: AF81201
2026-03-28 21:06:52 [auto1.it] INFO: Found listing with ID: YB05417
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB05417%27 HTTP/1.1" 200 None
2026-03-28 21:06:52 [auto1.it] INFO: Scrape type for YB05417: 0
2026-03-28 21:06:52 [auto1.it] INFO: Found listing with ID: PT68883
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT68883%27 HTTP/1.1" 200 None
2026-03-28 21:06:52 [auto1.it] INFO: Scrape type for PT68883: 0
2026-03-28 21:06:52 [auto1.it] INFO: Found listing with ID: LH69939
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LH69939%27 HTTP/1.1" 200 None
2026-03-28 21:06:52 [auto1.it] INFO: Scrape type for LH69939: 0
2026-03-28 21:06:52 [auto1.it] INFO: Found listing with ID: YH73900
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH73900%27 HTTP/1.1" 200 None
2026-03-28 21:06:52 [auto1.it] INFO: Scrape type for YH73900: 0
2026-03-28 21:06:52 [auto1.it] INFO: Found listing with ID: XC56824
2026-03-28 21:06:52 [auto1.it] INFO: Found listing with ID: LD48805
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD48805%27 HTTP/1.1" 200 None
2026-03-28 21:06:52 [auto1.it] INFO: Scrape type for LD48805: 0
2026-03-28 21:06:52 [auto1.it] INFO: Found listing with ID: FA93618
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA93618%27 HTTP/1.1" 200 None
2026-03-28 21:06:52 [auto1.it] INFO: Scrape type for FA93618: 0
2026-03-28 21:06:52 [auto1.it] INFO: Found listing with ID: GR86359
2026-03-28 21:06:52 [auto1.it] INFO: Found listing with ID: BR14904
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR14904%27 HTTP/1.1" 200 None
2026-03-28 21:06:52 [auto1.it] INFO: Scrape type for BR14904: 0
2026-03-28 21:06:52 [auto1.it] INFO: Found listing with ID: HX42058
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HX42058%27 HTTP/1.1" 200 None
2026-03-28 21:06:52 [auto1.it] INFO: Scrape type for HX42058: 0
2026-03-28 21:06:52 [auto1.it] INFO: Found listing with ID: BN39787
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN39787%27 HTTP/1.1" 200 None
2026-03-28 21:06:52 [auto1.it] INFO: Scrape type for BN39787: 2
2026-03-28 21:06:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51aa4ca5-78d3-5edc-809a-21971495e999 with identifier: BN39787
2026-03-28 21:06:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51aa4ca5-78d3-5edc-809a-21971495e999 with scrape type 2
2026-03-28 21:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51aa4ca5-78d3-5edc-809a-21971495e999 with scrape type 2
2026-03-28 21:06:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 51aa4ca5-78d3-5edc-809a-21971495e999, identifier: BN39787
2026-03-28 21:06:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 51aa4ca5-78d3-5edc-809a-21971495e999 with identifier: BN39787
2026-03-28 21:06:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 51aa4ca5-78d3-5edc-809a-21971495e999 with identifier: BN39787
2026-03-28 21:06:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 51aa4ca5-78d3-5edc-809a-21971495e999 with identifier: BN39787 to the API
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:03:00Z',
'fuel_type': 'diesel',
'id': '51aa4ca5-78d3-5edc-809a-21971495e999',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN39787',
'listing': 'auction',
'make': 'Ford',
'model': 'C-Max',
'odometer': 343941,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-10',
'seller_name': None,
'title': 'Ford C-Max 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2011}
2026-03-28 21:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN39787%27 HTTP/1.1" 200 None
2026-03-28 21:06:53 [auto1.it] INFO: Saving data for BN39787: {'auction_closing_time': 1774882980.0, 'created_time': 1774533954.672446, 'last_price_update_time': 1774732013.036856}
2026-03-28 21:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BN39787') HTTP/1.1" 204 0
2026-03-28 21:06:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:53 [auto1.it] INFO: Found listing with ID: LZ05951
2026-03-28 21:06:53 [auto1.it] INFO: Found listing with ID: DU09881
2026-03-28 21:06:53 [auto1.it] INFO: Found listing with ID: FX50490
2026-03-28 21:06:53 [auto1.it] INFO: Found listing with ID: HC78741
2026-03-28 21:06:53 [auto1.it] INFO: Found listing with ID: SR46685
2026-03-28 21:06:53 [auto1.it] INFO: Found listing with ID: TA87203
2026-03-28 21:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA87203%27 HTTP/1.1" 200 None
2026-03-28 21:06:53 [auto1.it] INFO: Scrape type for TA87203: 0
2026-03-28 21:06:53 [auto1.it] INFO: Found listing with ID: DW89993
2026-03-28 21:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW89993%27 HTTP/1.1" 200 None
2026-03-28 21:06:53 [auto1.it] INFO: Scrape type for DW89993: 2
2026-03-28 21:06:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb2fdea8-9105-50f6-bcdc-9a8ce14ee8f4 with identifier: DW89993
2026-03-28 21:06:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb2fdea8-9105-50f6-bcdc-9a8ce14ee8f4 with scrape type 2
2026-03-28 21:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb2fdea8-9105-50f6-bcdc-9a8ce14ee8f4 with scrape type 2
2026-03-28 21:06:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fb2fdea8-9105-50f6-bcdc-9a8ce14ee8f4, identifier: DW89993
2026-03-28 21:06:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fb2fdea8-9105-50f6-bcdc-9a8ce14ee8f4 with identifier: DW89993
2026-03-28 21:06:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fb2fdea8-9105-50f6-bcdc-9a8ce14ee8f4 with identifier: DW89993
2026-03-28 21:06:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fb2fdea8-9105-50f6-bcdc-9a8ce14ee8f4 with identifier: DW89993 to the API
2026-03-28 21:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 272,
'expiration_date': '2026-03-30T15:09:51Z',
'fuel_type': 'petrol',
'id': 'fb2fdea8-9105-50f6-bcdc-9a8ce14ee8f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW89993',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLS-Klasse',
'odometer': 157613,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-07-24',
'seller_name': None,
'title': 'Mercedes-Benz CLS-Klasse CLS 350',
'transmission': 'automatic',
'trim': '',
'year': 2005}
2026-03-28 21:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DW89993%27 HTTP/1.1" 200 None
2026-03-28 21:06:53 [auto1.it] INFO: Saving data for DW89993: {'auction_closing_time': 1774883391.0, 'created_time': 1772784409.173276, 'last_price_update_time': 1774732013.586898}
2026-03-28 21:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DW89993') HTTP/1.1" 204 0
2026-03-28 21:06:53 [auto1.it] INFO: Found listing with ID: EF98667
2026-03-28 21:06:53 [auto1.it] INFO: Found listing with ID: TB60435
2026-03-28 21:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB60435%27 HTTP/1.1" 200 None
2026-03-28 21:06:53 [auto1.it] INFO: Scrape type for TB60435: 0
2026-03-28 21:06:53 [auto1.it] INFO: Found listing with ID: GM11383
2026-03-28 21:06:53 [auto1.it] INFO: Found listing with ID: ZJ09783
2026-03-28 21:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ09783%27 HTTP/1.1" 200 None
2026-03-28 21:06:53 [auto1.it] INFO: Scrape type for ZJ09783: 0
2026-03-28 21:06:53 [auto1.it] INFO: Found listing with ID: KC12001
2026-03-28 21:06:53 [auto1.it] INFO: Found listing with ID: GG79286
2026-03-28 21:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GG79286%27 HTTP/1.1" 200 None
2026-03-28 21:06:53 [auto1.it] INFO: Scrape type for GG79286: 0
2026-03-28 21:06:53 [auto1.it] INFO: Found listing with ID: NB15044
2026-03-28 21:06:53 [auto1.it] INFO: Found listing with ID: VG33831
2026-03-28 21:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG33831%27 HTTP/1.1" 200 None
2026-03-28 21:06:53 [auto1.it] INFO: Scrape type for VG33831: 0
2026-03-28 21:06:53 [auto1.it] INFO: Found listing with ID: SL84548
2026-03-28 21:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL84548%27 HTTP/1.1" 200 None
2026-03-28 21:06:53 [auto1.it] INFO: Scrape type for SL84548: 0
2026-03-28 21:06:53 [auto1.it] INFO: Found listing with ID: ZV75074
2026-03-28 21:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZV75074%27 HTTP/1.1" 200 None
2026-03-28 21:06:53 [auto1.it] INFO: Scrape type for ZV75074: 0
2026-03-28 21:06:53 [auto1.it] INFO: Found listing with ID: FP61129
2026-03-28 21:06:53 [auto1.it] INFO: Found listing with ID: DZ84756
2026-03-28 21:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ84756%27 HTTP/1.1" 200 None
2026-03-28 21:06:53 [auto1.it] INFO: Scrape type for DZ84756: 0
2026-03-28 21:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:54 [auto1.it] INFO: Channel: 24h | Page: 32 | totalHits: 2224 | hits on page: 40
2026-03-28 21:06:54 [auto1.it] INFO: Found listing with ID: JZ46948
2026-03-28 21:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ46948%27 HTTP/1.1" 200 None
2026-03-28 21:06:54 [auto1.it] INFO: Scrape type for JZ46948: 1
2026-03-28 21:06:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:54 [auto1.it] INFO: Found listing with ID: CF35894
2026-03-28 21:06:54 [auto1.it] INFO: Found listing with ID: GU38190
2026-03-28 21:06:54 [auto1.it] INFO: Found listing with ID: DC62247
2026-03-28 21:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC62247%27 HTTP/1.1" 200 None
2026-03-28 21:06:54 [auto1.it] INFO: Scrape type for DC62247: 2
2026-03-28 21:06:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1238564c-6c70-54cb-a3dc-8ac7c972e23c with identifier: DC62247
2026-03-28 21:06:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1238564c-6c70-54cb-a3dc-8ac7c972e23c with scrape type 2
2026-03-28 21:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1238564c-6c70-54cb-a3dc-8ac7c972e23c with scrape type 2
2026-03-28 21:06:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1238564c-6c70-54cb-a3dc-8ac7c972e23c, identifier: DC62247
2026-03-28 21:06:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1238564c-6c70-54cb-a3dc-8ac7c972e23c with identifier: DC62247
2026-03-28 21:06:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1238564c-6c70-54cb-a3dc-8ac7c972e23c with identifier: DC62247
2026-03-28 21:06:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1238564c-6c70-54cb-a3dc-8ac7c972e23c with identifier: DC62247 to the API
2026-03-28 21:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:43:49Z',
'fuel_type': 'diesel',
'id': '1238564c-6c70-54cb-a3dc-8ac7c972e23c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC62247',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 175961,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-30',
'seller_name': None,
'title': 'Hyundai Tucson 1.7 CRDi Xpossible ISG 2WD',
'transmission': 'automatic',
'trim': 'Xpossible ISG 2WD',
'year': 2017}
2026-03-28 21:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC62247%27 HTTP/1.1" 200 None
2026-03-28 21:06:54 [auto1.it] INFO: Saving data for DC62247: {'auction_closing_time': 1774885429.0, 'created_time': 1773135851.023299, 'last_price_update_time': 1774732014.995491}
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DC62247') HTTP/1.1" 204 0
2026-03-28 21:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JJ50665> (referer: https://www.auto1.com/v1/car-details-view/JJ50665/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: KD87590
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD87590%27 HTTP/1.1" 200 None
2026-03-28 21:06:55 [auto1.it] INFO: Scrape type for KD87590: 0
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: JH32473
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH32473%27 HTTP/1.1" 200 None
2026-03-28 21:06:55 [auto1.it] INFO: Scrape type for JH32473: 0
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: VY00315
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: KA98059
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KA98059%27 HTTP/1.1" 200 None
2026-03-28 21:06:55 [auto1.it] INFO: Scrape type for KA98059: 0
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: HW82018
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW82018%27 HTTP/1.1" 200 None
2026-03-28 21:06:55 [auto1.it] INFO: Scrape type for HW82018: 0
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: VG76075
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG76075%27 HTTP/1.1" 200 None
2026-03-28 21:06:55 [auto1.it] INFO: Scrape type for VG76075: 0
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: UB96617
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: RF11851
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF11851%27 HTTP/1.1" 200 None
2026-03-28 21:06:55 [auto1.it] INFO: Scrape type for RF11851: 2
2026-03-28 21:06:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f343ee9d-e814-5cea-bd0d-4ae44adc0955 with identifier: RF11851
2026-03-28 21:06:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f343ee9d-e814-5cea-bd0d-4ae44adc0955 with scrape type 2
2026-03-28 21:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f343ee9d-e814-5cea-bd0d-4ae44adc0955 with scrape type 2
2026-03-28 21:06:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f343ee9d-e814-5cea-bd0d-4ae44adc0955, identifier: RF11851
2026-03-28 21:06:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f343ee9d-e814-5cea-bd0d-4ae44adc0955 with identifier: RF11851
2026-03-28 21:06:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f343ee9d-e814-5cea-bd0d-4ae44adc0955 with identifier: RF11851
2026-03-28 21:06:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f343ee9d-e814-5cea-bd0d-4ae44adc0955 with identifier: RF11851 to the API
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 220,
'expiration_date': '2026-03-30T15:02:51Z',
'fuel_type': 'diesel',
'id': 'f343ee9d-e814-5cea-bd0d-4ae44adc0955',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF11851',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 55218,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-12',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d Mild-Hybrid AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2021}
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF11851%27 HTTP/1.1" 200 None
2026-03-28 21:06:55 [auto1.it] INFO: Saving data for RF11851: {'auction_closing_time': 1774882971.0, 'created_time': 1774533945.591733, 'last_price_update_time': 1774732015.64152}
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RF11851') HTTP/1.1" 204 0
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: FL87170
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL87170%27 HTTP/1.1" 200 None
2026-03-28 21:06:55 [auto1.it] INFO: Scrape type for FL87170: 0
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: HC78855
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC78855%27 HTTP/1.1" 200 None
2026-03-28 21:06:55 [auto1.it] INFO: Scrape type for HC78855: 0
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: VF62325
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: NU40150
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NU40150%27 HTTP/1.1" 200 None
2026-03-28 21:06:55 [auto1.it] INFO: Scrape type for NU40150: 0
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: KT00361
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT00361%27 HTTP/1.1" 200 None
2026-03-28 21:06:55 [auto1.it] INFO: Scrape type for KT00361: 0
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: ZF04289
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF04289%27 HTTP/1.1" 200 None
2026-03-28 21:06:55 [auto1.it] INFO: Scrape type for ZF04289: 0
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: HA02667
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA02667%27 HTTP/1.1" 200 None
2026-03-28 21:06:55 [auto1.it] INFO: Scrape type for HA02667: 0
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: NC40954
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: UZ24263
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: LY33062
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: WF98355
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WF98355%27 HTTP/1.1" 200 None
2026-03-28 21:06:55 [auto1.it] INFO: Scrape type for WF98355: 0
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: RY75551
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY75551%27 HTTP/1.1" 200 None
2026-03-28 21:06:55 [auto1.it] INFO: Scrape type for RY75551: 0
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: GT17174
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: PW10693
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW10693%27 HTTP/1.1" 200 None
2026-03-28 21:06:55 [auto1.it] INFO: Scrape type for PW10693: 0
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: RV11940
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: RA84354
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: CC08861
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: SP14530
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: WH70643
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: TH32608
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: ZJ87985
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: RF43689
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF43689%27 HTTP/1.1" 200 None
2026-03-28 21:06:55 [auto1.it] INFO: Scrape type for RF43689: 0
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: BV06574
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: US24028
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US24028%27 HTTP/1.1" 200 None
2026-03-28 21:06:55 [auto1.it] INFO: Scrape type for US24028: 0
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: AS07739
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS07739%27 HTTP/1.1" 200 None
2026-03-28 21:06:55 [auto1.it] INFO: Scrape type for AS07739: 0
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: DW68997
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: DC13549
2026-03-28 21:06:55 [auto1.it] INFO: Found listing with ID: VB18666
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB18666%27 HTTP/1.1" 200 None
2026-03-28 21:06:55 [auto1.it] INFO: Scrape type for VB18666: 0
2026-03-28 21:06:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b2f500a-5a7a-590c-8048-9cb6040538bb with identifier: JJ50665
2026-03-28 21:06:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b2f500a-5a7a-590c-8048-9cb6040538bb with scrape type 1
2026-03-28 21:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b2f500a-5a7a-590c-8048-9cb6040538bb
2026-03-28 21:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F39%252F6739142aed8cfdc0bbc9f4531dca7283%252Fpa%252FJJ50665_06fed023ebeaf36fdce29be57f076f4b.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_06fed023ebeaf36fdce29be57f076f4b.jpg already downloaded
2026-03-28 21:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F39%252F6739142aed8cfdc0bbc9f4531dca7283%252Fpa%252FJJ50665_9b664fa09e212e96268ffd5e4c477a41.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_9b664fa09e212e96268ffd5e4c477a41.jpg already downloaded
2026-03-28 21:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F39%252F6739142aed8cfdc0bbc9f4531dca7283%252Fpa%252FJJ50665_ed39573b24e819baef8b68947fa00086.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_ed39573b24e819baef8b68947fa00086.jpg already downloaded
2026-03-28 21:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F39%252F6739142aed8cfdc0bbc9f4531dca7283%252Fpa%252FJJ50665_1efc4d8f47cb53843ab720f022794183.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_1efc4d8f47cb53843ab720f022794183.jpg already downloaded
2026-03-28 21:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F39%252F6739142aed8cfdc0bbc9f4531dca7283%252Fpa%252FJJ50665_7a2e0c420d6acd327c5006b9f13ade57.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_7a2e0c420d6acd327c5006b9f13ade57.jpg already downloaded
2026-03-28 21:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F39%252F6739142aed8cfdc0bbc9f4531dca7283%252Fpa%252FJJ50665_3fba060eee15c16b8a0bc01fdfd3c2ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_3fba060eee15c16b8a0bc01fdfd3c2ae.jpg already downloaded
2026-03-28 21:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F39%252F6739142aed8cfdc0bbc9f4531dca7283%252Fpa%252FJJ50665_664dead7f076259250736db364bcb8f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_664dead7f076259250736db364bcb8f4.jpg already downloaded
2026-03-28 21:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F39%252F6739142aed8cfdc0bbc9f4531dca7283%252Fpa%252FJJ50665_00678583a77d6ce6a1616b40af2a3680.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_00678583a77d6ce6a1616b40af2a3680.jpg already downloaded
2026-03-28 21:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F39%252F6739142aed8cfdc0bbc9f4531dca7283%252Fpa%252FJJ50665_a75b00bfd51f303359f28c459141dd0c.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_a75b00bfd51f303359f28c459141dd0c.jpg already downloaded
2026-03-28 21:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F39%252F6739142aed8cfdc0bbc9f4531dca7283%252Fpa%252FJJ50665_a3a69fc38033431a0023919ae0d8bf9e.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_a3a69fc38033431a0023919ae0d8bf9e.jpg already downloaded
2026-03-28 21:06:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9b2f500a-5a7a-590c-8048-9cb6040538bb, identifier: JJ50665
2026-03-28 21:06:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9b2f500a-5a7a-590c-8048-9cb6040538bb with identifier: JJ50665
2026-03-28 21:06:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9b2f500a-5a7a-590c-8048-9cb6040538bb with identifier: JJ50665
2026-03-28 21:06:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9b2f500a-5a7a-590c-8048-9cb6040538bb with identifier: JJ50665 to the API
2026-03-28 21:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JJ50665>
{'auction_title': '',
'c_o_2_emission_value': 174,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.2L',
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:09:56Z',
'fuel_type': 'diesel',
'id': '9b2f500a-5a7a-590c-8048-9cb6040538bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ50665',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 155949,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_06fed023ebeaf36fdce29be57f076f4b.jpg',
'https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_9b664fa09e212e96268ffd5e4c477a41.jpg',
'https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_ed39573b24e819baef8b68947fa00086.jpg',
'https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_1efc4d8f47cb53843ab720f022794183.jpg',
'https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_7a2e0c420d6acd327c5006b9f13ade57.jpg',
'https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_3fba060eee15c16b8a0bc01fdfd3c2ae.jpg',
'https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_664dead7f076259250736db364bcb8f4.jpg',
'https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_00678583a77d6ce6a1616b40af2a3680.jpg',
'https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_a75b00bfd51f303359f28c459141dd0c.jpg',
'https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_a3a69fc38033431a0023919ae0d8bf9e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2f500a-5a7a-590c-8048-9cb6040538bb/9b2f500a-5a7a-590c-8048-9cb6040538bb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84568,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_06fed023ebeaf36fdce29be57f076f4b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2f500a-5a7a-590c-8048-9cb6040538bb/9b2f500a-5a7a-590c-8048-9cb6040538bb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79530,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_9b664fa09e212e96268ffd5e4c477a41.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2f500a-5a7a-590c-8048-9cb6040538bb/9b2f500a-5a7a-590c-8048-9cb6040538bb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2742785,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_ed39573b24e819baef8b68947fa00086.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2f500a-5a7a-590c-8048-9cb6040538bb/9b2f500a-5a7a-590c-8048-9cb6040538bb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2344179,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_1efc4d8f47cb53843ab720f022794183.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2f500a-5a7a-590c-8048-9cb6040538bb/9b2f500a-5a7a-590c-8048-9cb6040538bb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82256,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_7a2e0c420d6acd327c5006b9f13ade57.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2f500a-5a7a-590c-8048-9cb6040538bb/9b2f500a-5a7a-590c-8048-9cb6040538bb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79365,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_3fba060eee15c16b8a0bc01fdfd3c2ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2f500a-5a7a-590c-8048-9cb6040538bb/9b2f500a-5a7a-590c-8048-9cb6040538bb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50272,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_664dead7f076259250736db364bcb8f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2f500a-5a7a-590c-8048-9cb6040538bb/9b2f500a-5a7a-590c-8048-9cb6040538bb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2288654,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_00678583a77d6ce6a1616b40af2a3680.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2f500a-5a7a-590c-8048-9cb6040538bb/9b2f500a-5a7a-590c-8048-9cb6040538bb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2818768,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_a75b00bfd51f303359f28c459141dd0c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2f500a-5a7a-590c-8048-9cb6040538bb/9b2f500a-5a7a-590c-8048-9cb6040538bb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2983668,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img67/39/6739142aed8cfdc0bbc9f4531dca7283/pa/JJ50665_a3a69fc38033431a0023919ae0d8bf9e.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-05-12',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Evoque 2.2 Td4 Pure',
'transmission': 'automatic',
'trim': 'Pure',
'year': 2013}
2026-03-28 21:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JJ50665%27 HTTP/1.1" 200 None
2026-03-28 21:06:56 [auto1.it] INFO: Saving data for JJ50665: {'created_time': 1774732016.650407, 'last_price_update_time': 1774732016.65042, 'auction_closing_time': 1774883396.0}
2026-03-28 21:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JJ50665') HTTP/1.1" 204 0
2026-03-28 21:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:57 [auto1.it] INFO: Channel: 24h | Page: 33 | totalHits: 2224 | hits on page: 40
2026-03-28 21:06:57 [auto1.it] INFO: Found listing with ID: ND31908
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ND31908%27 HTTP/1.1" 200 None
2026-03-28 21:06:57 [auto1.it] INFO: Scrape type for ND31908: 0
2026-03-28 21:06:57 [auto1.it] INFO: Found listing with ID: YT14284
2026-03-28 21:06:57 [auto1.it] INFO: Found listing with ID: XJ18858
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ18858%27 HTTP/1.1" 200 None
2026-03-28 21:06:57 [auto1.it] INFO: Scrape type for XJ18858: 0
2026-03-28 21:06:57 [auto1.it] INFO: Found listing with ID: MY00561
2026-03-28 21:06:57 [auto1.it] INFO: Found listing with ID: NP40750
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP40750%27 HTTP/1.1" 200 None
2026-03-28 21:06:57 [auto1.it] INFO: Scrape type for NP40750: 0
2026-03-28 21:06:57 [auto1.it] INFO: Found listing with ID: RS54948
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS54948%27 HTTP/1.1" 200 None
2026-03-28 21:06:57 [auto1.it] INFO: Scrape type for RS54948: 0
2026-03-28 21:06:57 [auto1.it] INFO: Found listing with ID: ZK89803
2026-03-28 21:06:57 [auto1.it] INFO: Found listing with ID: UP03227
2026-03-28 21:06:57 [auto1.it] INFO: Found listing with ID: VD09142
2026-03-28 21:06:57 [auto1.it] INFO: Found listing with ID: XJ13084
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XJ13084%27 HTTP/1.1" 200 None
2026-03-28 21:06:57 [auto1.it] INFO: Scrape type for XJ13084: 0
2026-03-28 21:06:57 [auto1.it] INFO: Found listing with ID: VT42722
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VT42722%27 HTTP/1.1" 200 None
2026-03-28 21:06:57 [auto1.it] INFO: Scrape type for VT42722: 0
2026-03-28 21:06:57 [auto1.it] INFO: Found listing with ID: DS02463
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS02463%27 HTTP/1.1" 200 None
2026-03-28 21:06:57 [auto1.it] INFO: Scrape type for DS02463: 0
2026-03-28 21:06:57 [auto1.it] INFO: Found listing with ID: VP48054
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP48054%27 HTTP/1.1" 200 None
2026-03-28 21:06:57 [auto1.it] INFO: Scrape type for VP48054: 2
2026-03-28 21:06:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab759288-f627-5e48-93fa-61d15d7df771 with identifier: VP48054
2026-03-28 21:06:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab759288-f627-5e48-93fa-61d15d7df771 with scrape type 2
2026-03-28 21:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab759288-f627-5e48-93fa-61d15d7df771 with scrape type 2
2026-03-28 21:06:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ab759288-f627-5e48-93fa-61d15d7df771, identifier: VP48054
2026-03-28 21:06:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ab759288-f627-5e48-93fa-61d15d7df771 with identifier: VP48054
2026-03-28 21:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ab759288-f627-5e48-93fa-61d15d7df771 with identifier: VP48054
2026-03-28 21:06:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ab759288-f627-5e48-93fa-61d15d7df771 with identifier: VP48054 to the API
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:10:55Z',
'fuel_type': 'diesel',
'id': 'ab759288-f627-5e48-93fa-61d15d7df771',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP48054',
'listing': 'auction',
'make': 'BMW',
'model': 'X4',
'odometer': 360936,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-27',
'seller_name': None,
'title': 'BMW X4 xDrive 20d Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2017}
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP48054%27 HTTP/1.1" 200 None
2026-03-28 21:06:57 [auto1.it] INFO: Saving data for VP48054: {'auction_closing_time': 1774883455.0, 'created_time': 1774645614.150778, 'last_price_update_time': 1774732017.717478}
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VP48054') HTTP/1.1" 204 0
2026-03-28 21:06:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:57 [auto1.it] INFO: Found listing with ID: FU99331
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU99331%27 HTTP/1.1" 200 None
2026-03-28 21:06:57 [auto1.it] INFO: Scrape type for FU99331: 0
2026-03-28 21:06:57 [auto1.it] INFO: Found listing with ID: WL66559
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL66559%27 HTTP/1.1" 200 None
2026-03-28 21:06:57 [auto1.it] INFO: Scrape type for WL66559: 0
2026-03-28 21:06:57 [auto1.it] INFO: Found listing with ID: ZE21394
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE21394%27 HTTP/1.1" 200 None
2026-03-28 21:06:57 [auto1.it] INFO: Scrape type for ZE21394: 0
2026-03-28 21:06:57 [auto1.it] INFO: Found listing with ID: JW95602
2026-03-28 21:06:57 [auto1.it] INFO: Found listing with ID: JF95895
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF95895%27 HTTP/1.1" 200 None
2026-03-28 21:06:57 [auto1.it] INFO: Scrape type for JF95895: 0
2026-03-28 21:06:57 [auto1.it] INFO: Found listing with ID: ZU06634
2026-03-28 21:06:57 [auto1.it] INFO: Found listing with ID: DT24064
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT24064%27 HTTP/1.1" 200 None
2026-03-28 21:06:57 [auto1.it] INFO: Scrape type for DT24064: 0
2026-03-28 21:06:57 [auto1.it] INFO: Found listing with ID: KM59258
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM59258%27 HTTP/1.1" 200 None
2026-03-28 21:06:57 [auto1.it] INFO: Scrape type for KM59258: 0
2026-03-28 21:06:57 [auto1.it] INFO: Found listing with ID: RM50913
2026-03-28 21:06:57 [auto1.it] INFO: Found listing with ID: CY97706
2026-03-28 21:06:57 [auto1.it] INFO: Found listing with ID: TY61219
2026-03-28 21:06:57 [auto1.it] INFO: Found listing with ID: VV63992
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV63992%27 HTTP/1.1" 200 None
2026-03-28 21:06:57 [auto1.it] INFO: Scrape type for VV63992: 0
2026-03-28 21:06:57 [auto1.it] INFO: Found listing with ID: DD55036
2026-03-28 21:06:57 [auto1.it] INFO: Found listing with ID: PM10461
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM10461%27 HTTP/1.1" 200 None
2026-03-28 21:06:57 [auto1.it] INFO: Scrape type for PM10461: 0
2026-03-28 21:06:57 [auto1.it] INFO: Found listing with ID: JN19530
2026-03-28 21:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN19530%27 HTTP/1.1" 200 None
2026-03-28 21:06:58 [auto1.it] INFO: Scrape type for JN19530: 0
2026-03-28 21:06:58 [auto1.it] INFO: Found listing with ID: FS34329
2026-03-28 21:06:58 [auto1.it] INFO: Found listing with ID: PV13410
2026-03-28 21:06:58 [auto1.it] INFO: Found listing with ID: AV12122
2026-03-28 21:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV12122%27 HTTP/1.1" 200 None
2026-03-28 21:06:58 [auto1.it] INFO: Scrape type for AV12122: 0
2026-03-28 21:06:58 [auto1.it] INFO: Found listing with ID: ZZ56254
2026-03-28 21:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ56254%27 HTTP/1.1" 200 None
2026-03-28 21:06:58 [auto1.it] INFO: Scrape type for ZZ56254: 0
2026-03-28 21:06:58 [auto1.it] INFO: Found listing with ID: UN43339
2026-03-28 21:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN43339%27 HTTP/1.1" 200 None
2026-03-28 21:06:58 [auto1.it] INFO: Scrape type for UN43339: 0
2026-03-28 21:06:58 [auto1.it] INFO: Found listing with ID: PV39557
2026-03-28 21:06:58 [auto1.it] INFO: Found listing with ID: ZE71737
2026-03-28 21:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE71737%27 HTTP/1.1" 200 None
2026-03-28 21:06:58 [auto1.it] INFO: Scrape type for ZE71737: 0
2026-03-28 21:06:58 [auto1.it] INFO: Found listing with ID: FP75199
2026-03-28 21:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP75199%27 HTTP/1.1" 200 None
2026-03-28 21:06:58 [auto1.it] INFO: Scrape type for FP75199: 0
2026-03-28 21:06:58 [auto1.it] INFO: Found listing with ID: GJ95983
2026-03-28 21:06:58 [auto1.it] INFO: Found listing with ID: HH07211
2026-03-28 21:06:58 [auto1.it] INFO: Found listing with ID: FY46493
2026-03-28 21:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FY46493%27 HTTP/1.1" 200 None
2026-03-28 21:06:58 [auto1.it] INFO: Scrape type for FY46493: 0
2026-03-28 21:06:58 [auto1.it] INFO: Found listing with ID: AF82865
2026-03-28 21:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF82865%27 HTTP/1.1" 200 None
2026-03-28 21:06:58 [auto1.it] INFO: Scrape type for AF82865: 2
2026-03-28 21:06:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12652bfd-88f7-5d86-9dbf-b615ce4dffee with identifier: AF82865
2026-03-28 21:06:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12652bfd-88f7-5d86-9dbf-b615ce4dffee with scrape type 2
2026-03-28 21:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12652bfd-88f7-5d86-9dbf-b615ce4dffee with scrape type 2
2026-03-28 21:06:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 12652bfd-88f7-5d86-9dbf-b615ce4dffee, identifier: AF82865
2026-03-28 21:06:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 12652bfd-88f7-5d86-9dbf-b615ce4dffee with identifier: AF82865
2026-03-28 21:06:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 12652bfd-88f7-5d86-9dbf-b615ce4dffee with identifier: AF82865
2026-03-28 21:06:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 12652bfd-88f7-5d86-9dbf-b615ce4dffee with identifier: AF82865 to the API
2026-03-28 21:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:06:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:06:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:01:57Z',
'fuel_type': 'diesel',
'id': '12652bfd-88f7-5d86-9dbf-b615ce4dffee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF82865',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 124910,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-29',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180 CDI Executive',
'transmission': 'automatic',
'trim': 'Executive',
'year': 2014}
2026-03-28 21:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF82865%27 HTTP/1.1" 200 None
2026-03-28 21:06:58 [auto1.it] INFO: Saving data for AF82865: {'auction_closing_time': 1774882917.0, 'created_time': 1772627932.223844, 'last_price_update_time': 1774732018.57362}
2026-03-28 21:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AF82865') HTTP/1.1" 204 0
2026-03-28 21:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JZ46948/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:06:59 [auto1.it] INFO: Channel: 24h | Page: 34 | totalHits: 2224 | hits on page: 40
2026-03-28 21:06:59 [auto1.it] INFO: Found listing with ID: NZ40909
2026-03-28 21:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ40909%27 HTTP/1.1" 200 None
2026-03-28 21:06:59 [auto1.it] INFO: Scrape type for NZ40909: 0
2026-03-28 21:06:59 [auto1.it] INFO: Found listing with ID: LG18660
2026-03-28 21:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG18660%27 HTTP/1.1" 200 None
2026-03-28 21:06:59 [auto1.it] INFO: Scrape type for LG18660: 0
2026-03-28 21:06:59 [auto1.it] INFO: Found listing with ID: SE98453
2026-03-28 21:06:59 [auto1.it] INFO: Found listing with ID: TJ64738
2026-03-28 21:06:59 [auto1.it] INFO: Found listing with ID: UB44414
2026-03-28 21:06:59 [auto1.it] INFO: Found listing with ID: EU82988
2026-03-28 21:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU82988%27 HTTP/1.1" 200 None
2026-03-28 21:06:59 [auto1.it] INFO: Scrape type for EU82988: 2
2026-03-28 21:06:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ffc93d3-e915-571e-a53a-6555283d0218 with identifier: EU82988
2026-03-28 21:06:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ffc93d3-e915-571e-a53a-6555283d0218 with scrape type 2
2026-03-28 21:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ffc93d3-e915-571e-a53a-6555283d0218 with scrape type 2
2026-03-28 21:06:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8ffc93d3-e915-571e-a53a-6555283d0218, identifier: EU82988
2026-03-28 21:06:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8ffc93d3-e915-571e-a53a-6555283d0218 with identifier: EU82988
2026-03-28 21:06:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8ffc93d3-e915-571e-a53a-6555283d0218 with identifier: EU82988
2026-03-28 21:06:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8ffc93d3-e915-571e-a53a-6555283d0218 with identifier: EU82988 to the API
2026-03-28 21:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:46:42Z',
'fuel_type': 'diesel',
'id': '8ffc93d3-e915-571e-a53a-6555283d0218',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU82988',
'listing': 'auction',
'make': 'Ford',
'model': 'C-Max',
'odometer': 295786,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-30',
'seller_name': None,
'title': 'Ford C-Max 1.6 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2012}
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU82988%27 HTTP/1.1" 200 None
2026-03-28 21:07:00 [auto1.it] INFO: Saving data for EU82988: {'auction_closing_time': 1774885602.0, 'created_time': 1774533959.545454, 'last_price_update_time': 1774732020.225582}
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EU82988') HTTP/1.1" 204 0
2026-03-28 21:07:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:00 [auto1.it] INFO: Found listing with ID: SM22245
2026-03-28 21:07:00 [auto1.it] INFO: Found listing with ID: LD41720
2026-03-28 21:07:00 [auto1.it] INFO: Found listing with ID: DL42775
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL42775%27 HTTP/1.1" 200 None
2026-03-28 21:07:00 [auto1.it] INFO: Scrape type for DL42775: 2
2026-03-28 21:07:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8309716b-bcaf-55a6-99d1-40ed6909633c with identifier: DL42775
2026-03-28 21:07:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8309716b-bcaf-55a6-99d1-40ed6909633c with scrape type 2
2026-03-28 21:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8309716b-bcaf-55a6-99d1-40ed6909633c with scrape type 2
2026-03-28 21:07:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8309716b-bcaf-55a6-99d1-40ed6909633c, identifier: DL42775
2026-03-28 21:07:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8309716b-bcaf-55a6-99d1-40ed6909633c with identifier: DL42775
2026-03-28 21:07:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8309716b-bcaf-55a6-99d1-40ed6909633c with identifier: DL42775
2026-03-28 21:07:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8309716b-bcaf-55a6-99d1-40ed6909633c with identifier: DL42775 to the API
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:01:42Z',
'fuel_type': 'petrol',
'id': '8309716b-bcaf-55a6-99d1-40ed6909633c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL42775',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 75466,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-28',
'seller_name': None,
'title': 'BMW X3 xDrive 20i xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2019}
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL42775%27 HTTP/1.1" 200 None
2026-03-28 21:07:00 [auto1.it] INFO: Saving data for DL42775: {'auction_closing_time': 1774882902.0, 'created_time': 1773129516.210225, 'last_price_update_time': 1774732020.668593}
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DL42775') HTTP/1.1" 204 0
2026-03-28 21:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JZ46948> (referer: https://www.auto1.com/v1/car-details-view/JZ46948/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:00 [auto1.it] INFO: Found listing with ID: DP88225
2026-03-28 21:07:00 [auto1.it] INFO: Found listing with ID: GV75261
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV75261%27 HTTP/1.1" 200 None
2026-03-28 21:07:00 [auto1.it] INFO: Scrape type for GV75261: 0
2026-03-28 21:07:00 [auto1.it] INFO: Found listing with ID: JJ49663
2026-03-28 21:07:00 [auto1.it] INFO: Found listing with ID: DB04877
2026-03-28 21:07:00 [auto1.it] INFO: Found listing with ID: XV39349
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV39349%27 HTTP/1.1" 200 None
2026-03-28 21:07:00 [auto1.it] INFO: Scrape type for XV39349: 0
2026-03-28 21:07:00 [auto1.it] INFO: Found listing with ID: TA75240
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TA75240%27 HTTP/1.1" 200 None
2026-03-28 21:07:00 [auto1.it] INFO: Scrape type for TA75240: 0
2026-03-28 21:07:00 [auto1.it] INFO: Found listing with ID: LZ50355
2026-03-28 21:07:00 [auto1.it] INFO: Found listing with ID: UA89499
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA89499%27 HTTP/1.1" 200 None
2026-03-28 21:07:00 [auto1.it] INFO: Scrape type for UA89499: 0
2026-03-28 21:07:00 [auto1.it] INFO: Found listing with ID: CN31542
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN31542%27 HTTP/1.1" 200 None
2026-03-28 21:07:00 [auto1.it] INFO: Scrape type for CN31542: 0
2026-03-28 21:07:00 [auto1.it] INFO: Found listing with ID: BV97691
2026-03-28 21:07:00 [auto1.it] INFO: Found listing with ID: LV04843
2026-03-28 21:07:00 [auto1.it] INFO: Found listing with ID: HZ93936
2026-03-28 21:07:00 [auto1.it] INFO: Found listing with ID: FS29770
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS29770%27 HTTP/1.1" 200 None
2026-03-28 21:07:00 [auto1.it] INFO: Scrape type for FS29770: 0
2026-03-28 21:07:00 [auto1.it] INFO: Found listing with ID: WA74830
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA74830%27 HTTP/1.1" 200 None
2026-03-28 21:07:00 [auto1.it] INFO: Scrape type for WA74830: 0
2026-03-28 21:07:00 [auto1.it] INFO: Found listing with ID: BY06123
2026-03-28 21:07:00 [auto1.it] INFO: Found listing with ID: KD78044
2026-03-28 21:07:00 [auto1.it] INFO: Found listing with ID: TD31675
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD31675%27 HTTP/1.1" 200 None
2026-03-28 21:07:00 [auto1.it] INFO: Scrape type for TD31675: 0
2026-03-28 21:07:00 [auto1.it] INFO: Found listing with ID: LG36476
2026-03-28 21:07:00 [auto1.it] INFO: Found listing with ID: DV58522
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV58522%27 HTTP/1.1" 200 None
2026-03-28 21:07:00 [auto1.it] INFO: Scrape type for DV58522: 0
2026-03-28 21:07:00 [auto1.it] INFO: Found listing with ID: UB21320
2026-03-28 21:07:00 [auto1.it] INFO: Found listing with ID: TV19217
2026-03-28 21:07:00 [auto1.it] INFO: Found listing with ID: HD69394
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD69394%27 HTTP/1.1" 200 None
2026-03-28 21:07:00 [auto1.it] INFO: Scrape type for HD69394: 0
2026-03-28 21:07:00 [auto1.it] INFO: Found listing with ID: PM68240
2026-03-28 21:07:00 [auto1.it] INFO: Found listing with ID: CH03473
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH03473%27 HTTP/1.1" 200 None
2026-03-28 21:07:00 [auto1.it] INFO: Scrape type for CH03473: 0
2026-03-28 21:07:00 [auto1.it] INFO: Found listing with ID: TE47770
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE47770%27 HTTP/1.1" 200 None
2026-03-28 21:07:00 [auto1.it] INFO: Scrape type for TE47770: 0
2026-03-28 21:07:00 [auto1.it] INFO: Found listing with ID: BZ06099
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ06099%27 HTTP/1.1" 200 None
2026-03-28 21:07:01 [auto1.it] INFO: Scrape type for BZ06099: 0
2026-03-28 21:07:01 [auto1.it] INFO: Found listing with ID: SS52204
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS52204%27 HTTP/1.1" 200 None
2026-03-28 21:07:01 [auto1.it] INFO: Scrape type for SS52204: 0
2026-03-28 21:07:01 [auto1.it] INFO: Found listing with ID: ZL28386
2026-03-28 21:07:01 [auto1.it] INFO: Found listing with ID: PT89621
2026-03-28 21:07:01 [auto1.it] INFO: Found listing with ID: HX75119
2026-03-28 21:07:01 [auto1.it] INFO: Found listing with ID: HY34989
2026-03-28 21:07:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d783b71-1e2d-5ed0-b0de-547aaabb5dcf with identifier: JZ46948
2026-03-28 21:07:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d783b71-1e2d-5ed0-b0de-547aaabb5dcf with scrape type 1
2026-03-28 21:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6d783b71-1e2d-5ed0-b0de-547aaabb5dcf
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F76%252F707632cb507cef7ef79704654d00de8b%252Fpa%252FJZ46948_f2afc86b60c4b5ba77ceb6f63092e4a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_f2afc86b60c4b5ba77ceb6f63092e4a7.jpg already downloaded
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F76%252F707632cb507cef7ef79704654d00de8b%252Fpa%252FJZ46948_d0f0b77c8437b04e1fa68056e16c8733.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_d0f0b77c8437b04e1fa68056e16c8733.jpg already downloaded
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F76%252F707632cb507cef7ef79704654d00de8b%252Fpa%252FJZ46948_f5e7fa28795a0fde2ef68b0292692082.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_f5e7fa28795a0fde2ef68b0292692082.jpg already downloaded
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F76%252F707632cb507cef7ef79704654d00de8b%252Fpa%252FJZ46948_49a01724c2444c40bd4fd736486bc910.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_49a01724c2444c40bd4fd736486bc910.jpg already downloaded
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F76%252F707632cb507cef7ef79704654d00de8b%252Fpa%252FJZ46948_22122c93f57bd3b0a7f8a56ae1eeade8.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_22122c93f57bd3b0a7f8a56ae1eeade8.jpg already downloaded
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F76%252F707632cb507cef7ef79704654d00de8b%252Fpa%252FJZ46948_1ef9724f54cfdfd278828d3c08f13e6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_1ef9724f54cfdfd278828d3c08f13e6a.jpg already downloaded
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F76%252F707632cb507cef7ef79704654d00de8b%252Fpa%252FJZ46948_888612f0269b5b55c4bb9aa0b97ab5e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_888612f0269b5b55c4bb9aa0b97ab5e9.jpg already downloaded
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F76%252F707632cb507cef7ef79704654d00de8b%252Fpa%252FJZ46948_40a5746678219e171f96ad88f7381f89.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_40a5746678219e171f96ad88f7381f89.jpg already downloaded
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F76%252F707632cb507cef7ef79704654d00de8b%252Fpa%252FJZ46948_03fe65c4cb70bea23749e7c443b4e13e.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_03fe65c4cb70bea23749e7c443b4e13e.jpg already downloaded
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F76%252F707632cb507cef7ef79704654d00de8b%252Fpa%252FJZ46948_dcf3d91049156eb0fc131bd0825b68b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_dcf3d91049156eb0fc131bd0825b68b4.jpg already downloaded
2026-03-28 21:07:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6d783b71-1e2d-5ed0-b0de-547aaabb5dcf, identifier: JZ46948
2026-03-28 21:07:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6d783b71-1e2d-5ed0-b0de-547aaabb5dcf with identifier: JZ46948
2026-03-28 21:07:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6d783b71-1e2d-5ed0-b0de-547aaabb5dcf with identifier: JZ46948
2026-03-28 21:07:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6d783b71-1e2d-5ed0-b0de-547aaabb5dcf with identifier: JZ46948 to the API
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JZ46948>
{'auction_title': '',
'c_o_2_emission_value': 55,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 341,
'expiration_date': '2026-03-30T15:11:45Z',
'fuel_type': 'hybrid',
'id': '6d783b71-1e2d-5ed0-b0de-547aaabb5dcf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ46948',
'listing': 'auction',
'location': 'IT, Padova',
'make': 'Volvo',
'model': 'XC60',
'odometer': 47567,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_f2afc86b60c4b5ba77ceb6f63092e4a7.jpg',
'https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_d0f0b77c8437b04e1fa68056e16c8733.jpg',
'https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_f5e7fa28795a0fde2ef68b0292692082.jpg',
'https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_49a01724c2444c40bd4fd736486bc910.jpg',
'https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_22122c93f57bd3b0a7f8a56ae1eeade8.jpg',
'https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_1ef9724f54cfdfd278828d3c08f13e6a.jpg',
'https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_888612f0269b5b55c4bb9aa0b97ab5e9.jpg',
'https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_40a5746678219e171f96ad88f7381f89.jpg',
'https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_03fe65c4cb70bea23749e7c443b4e13e.jpg',
'https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_dcf3d91049156eb0fc131bd0825b68b4.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d783b71-1e2d-5ed0-b0de-547aaabb5dcf/6d783b71-1e2d-5ed0-b0de-547aaabb5dcf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64428,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_f2afc86b60c4b5ba77ceb6f63092e4a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d783b71-1e2d-5ed0-b0de-547aaabb5dcf/6d783b71-1e2d-5ed0-b0de-547aaabb5dcf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73592,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_d0f0b77c8437b04e1fa68056e16c8733.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d783b71-1e2d-5ed0-b0de-547aaabb5dcf/6d783b71-1e2d-5ed0-b0de-547aaabb5dcf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47652,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_f5e7fa28795a0fde2ef68b0292692082.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d783b71-1e2d-5ed0-b0de-547aaabb5dcf/6d783b71-1e2d-5ed0-b0de-547aaabb5dcf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59380,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_49a01724c2444c40bd4fd736486bc910.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d783b71-1e2d-5ed0-b0de-547aaabb5dcf/6d783b71-1e2d-5ed0-b0de-547aaabb5dcf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61842,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_22122c93f57bd3b0a7f8a56ae1eeade8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d783b71-1e2d-5ed0-b0de-547aaabb5dcf/6d783b71-1e2d-5ed0-b0de-547aaabb5dcf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76904,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_1ef9724f54cfdfd278828d3c08f13e6a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d783b71-1e2d-5ed0-b0de-547aaabb5dcf/6d783b71-1e2d-5ed0-b0de-547aaabb5dcf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70598,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_888612f0269b5b55c4bb9aa0b97ab5e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d783b71-1e2d-5ed0-b0de-547aaabb5dcf/6d783b71-1e2d-5ed0-b0de-547aaabb5dcf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76025,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_40a5746678219e171f96ad88f7381f89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d783b71-1e2d-5ed0-b0de-547aaabb5dcf/6d783b71-1e2d-5ed0-b0de-547aaabb5dcf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71970,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_03fe65c4cb70bea23749e7c443b4e13e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d783b71-1e2d-5ed0-b0de-547aaabb5dcf/6d783b71-1e2d-5ed0-b0de-547aaabb5dcf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80360,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img70/76/707632cb507cef7ef79704654d00de8b/pa/JZ46948_dcf3d91049156eb0fc131bd0825b68b4.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-04-12',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC60 2.0 T6 Plug-in Hybrid Inscription Expression AWD',
'transmission': 'automatic',
'trim': 'Inscription Expression AWD',
'year': 2022}
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ46948%27 HTTP/1.1" 200 None
2026-03-28 21:07:01 [auto1.it] INFO: Saving data for JZ46948: {'created_time': 1774732021.681003, 'last_price_update_time': 1774732021.681015, 'auction_closing_time': 1774883505.0}
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JZ46948') HTTP/1.1" 204 0
2026-03-28 21:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:02 [auto1.it] INFO: Channel: 24h | Page: 35 | totalHits: 2224 | hits on page: 40
2026-03-28 21:07:02 [auto1.it] INFO: Found listing with ID: KR37794
2026-03-28 21:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR37794%27 HTTP/1.1" 200 None
2026-03-28 21:07:02 [auto1.it] INFO: Scrape type for KR37794: 0
2026-03-28 21:07:02 [auto1.it] INFO: Found listing with ID: XV25356
2026-03-28 21:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV25356%27 HTTP/1.1" 200 None
2026-03-28 21:07:02 [auto1.it] INFO: Scrape type for XV25356: 0
2026-03-28 21:07:02 [auto1.it] INFO: Found listing with ID: FP20263
2026-03-28 21:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP20263%27 HTTP/1.1" 200 None
2026-03-28 21:07:02 [auto1.it] INFO: Scrape type for FP20263: 0
2026-03-28 21:07:02 [auto1.it] INFO: Found listing with ID: UY39151
2026-03-28 21:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY39151%27 HTTP/1.1" 200 None
2026-03-28 21:07:02 [auto1.it] INFO: Scrape type for UY39151: 0
2026-03-28 21:07:02 [auto1.it] INFO: Found listing with ID: JY70774
2026-03-28 21:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY70774%27 HTTP/1.1" 200 None
2026-03-28 21:07:02 [auto1.it] INFO: Scrape type for JY70774: 0
2026-03-28 21:07:02 [auto1.it] INFO: Found listing with ID: RL97939
2026-03-28 21:07:02 [auto1.it] INFO: Found listing with ID: UR73173
2026-03-28 21:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR73173%27 HTTP/1.1" 200 None
2026-03-28 21:07:02 [auto1.it] INFO: Scrape type for UR73173: 2
2026-03-28 21:07:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 440e9e96-005e-5689-9f9a-55fc04c41dca with identifier: UR73173
2026-03-28 21:07:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 440e9e96-005e-5689-9f9a-55fc04c41dca with scrape type 2
2026-03-28 21:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 440e9e96-005e-5689-9f9a-55fc04c41dca with scrape type 2
2026-03-28 21:07:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 440e9e96-005e-5689-9f9a-55fc04c41dca, identifier: UR73173
2026-03-28 21:07:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 440e9e96-005e-5689-9f9a-55fc04c41dca with identifier: UR73173
2026-03-28 21:07:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 440e9e96-005e-5689-9f9a-55fc04c41dca with identifier: UR73173
2026-03-28 21:07:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 440e9e96-005e-5689-9f9a-55fc04c41dca with identifier: UR73173 to the API
2026-03-28 21:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:44:12Z',
'fuel_type': 'diesel',
'id': '440e9e96-005e-5689-9f9a-55fc04c41dca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR73173',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Bipper',
'odometer': 151944,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-15',
'seller_name': None,
'title': 'Peugeot Bipper 1.3 HDi Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2015}
2026-03-28 21:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR73173%27 HTTP/1.1" 200 None
2026-03-28 21:07:03 [auto1.it] INFO: Saving data for UR73173: {'auction_closing_time': 1774885452.0, 'created_time': 1774533958.197391, 'last_price_update_time': 1774732023.355358}
2026-03-28 21:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UR73173') HTTP/1.1" 204 0
2026-03-28 21:07:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:03 [auto1.it] INFO: Found listing with ID: UP17064
2026-03-28 21:07:03 [auto1.it] INFO: Found listing with ID: TT52453
2026-03-28 21:07:03 [auto1.it] INFO: Found listing with ID: SM29752
2026-03-28 21:07:03 [auto1.it] INFO: Found listing with ID: WW47132
2026-03-28 21:07:03 [auto1.it] INFO: Found listing with ID: DL97052
2026-03-28 21:07:03 [auto1.it] INFO: Found listing with ID: PJ46449
2026-03-28 21:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PJ46449%27 HTTP/1.1" 200 None
2026-03-28 21:07:03 [auto1.it] INFO: Scrape type for PJ46449: 0
2026-03-28 21:07:03 [auto1.it] INFO: Found listing with ID: DX82404
2026-03-28 21:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX82404%27 HTTP/1.1" 200 None
2026-03-28 21:07:03 [auto1.it] INFO: Scrape type for DX82404: 0
2026-03-28 21:07:03 [auto1.it] INFO: Found listing with ID: DX25254
2026-03-28 21:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX25254%27 HTTP/1.1" 200 None
2026-03-28 21:07:03 [auto1.it] INFO: Scrape type for DX25254: 0
2026-03-28 21:07:03 [auto1.it] INFO: Found listing with ID: MJ86480
2026-03-28 21:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ86480%27 HTTP/1.1" 200 None
2026-03-28 21:07:03 [auto1.it] INFO: Scrape type for MJ86480: 0
2026-03-28 21:07:03 [auto1.it] INFO: Found listing with ID: PK74621
2026-03-28 21:07:03 [auto1.it] INFO: Found listing with ID: AR18622
2026-03-28 21:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR18622%27 HTTP/1.1" 200 None
2026-03-28 21:07:03 [auto1.it] INFO: Scrape type for AR18622: 1
2026-03-28 21:07:03 [auto1.it] INFO: Found listing with ID: MZ58050
2026-03-28 21:07:03 [auto1.it] INFO: Found listing with ID: XZ72452
2026-03-28 21:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XZ72452%27 HTTP/1.1" 200 None
2026-03-28 21:07:03 [auto1.it] INFO: Scrape type for XZ72452: 0
2026-03-28 21:07:03 [auto1.it] INFO: Found listing with ID: RB26067
2026-03-28 21:07:03 [auto1.it] INFO: Found listing with ID: TR59701
2026-03-28 21:07:03 [auto1.it] INFO: Found listing with ID: NV87278
2026-03-28 21:07:03 [auto1.it] INFO: Found listing with ID: SJ09087
2026-03-28 21:07:03 [auto1.it] INFO: Found listing with ID: SX19566
2026-03-28 21:07:03 [auto1.it] INFO: Found listing with ID: FD12268
2026-03-28 21:07:03 [auto1.it] INFO: Found listing with ID: HY91699
2026-03-28 21:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY91699%27 HTTP/1.1" 200 None
2026-03-28 21:07:03 [auto1.it] INFO: Scrape type for HY91699: 0
2026-03-28 21:07:03 [auto1.it] INFO: Found listing with ID: YT66548
2026-03-28 21:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT66548%27 HTTP/1.1" 200 None
2026-03-28 21:07:03 [auto1.it] INFO: Scrape type for YT66548: 0
2026-03-28 21:07:03 [auto1.it] INFO: Found listing with ID: ZR48768
2026-03-28 21:07:03 [auto1.it] INFO: Found listing with ID: CB66149
2026-03-28 21:07:03 [auto1.it] INFO: Found listing with ID: UM17769
2026-03-28 21:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM17769%27 HTTP/1.1" 200 None
2026-03-28 21:07:03 [auto1.it] INFO: Scrape type for UM17769: 2
2026-03-28 21:07:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9119bec-f2aa-5e58-9a89-55df3d18d3f9 with identifier: UM17769
2026-03-28 21:07:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9119bec-f2aa-5e58-9a89-55df3d18d3f9 with scrape type 2
2026-03-28 21:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9119bec-f2aa-5e58-9a89-55df3d18d3f9 with scrape type 2
2026-03-28 21:07:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d9119bec-f2aa-5e58-9a89-55df3d18d3f9, identifier: UM17769
2026-03-28 21:07:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d9119bec-f2aa-5e58-9a89-55df3d18d3f9 with identifier: UM17769
2026-03-28 21:07:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d9119bec-f2aa-5e58-9a89-55df3d18d3f9 with identifier: UM17769
2026-03-28 21:07:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d9119bec-f2aa-5e58-9a89-55df3d18d3f9 with identifier: UM17769 to the API
2026-03-28 21:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:33:35Z',
'fuel_type': 'diesel',
'id': 'd9119bec-f2aa-5e58-9a89-55df3d18d3f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM17769',
'listing': 'auction',
'make': 'MINI',
'model': 'Countryman',
'odometer': 164671,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-31',
'seller_name': None,
'title': 'MINI Countryman Cooper SD ALL4',
'transmission': 'automatic',
'trim': 'ALL4',
'year': 2016}
2026-03-28 21:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM17769%27 HTTP/1.1" 200 None
2026-03-28 21:07:03 [auto1.it] INFO: Saving data for UM17769: {'auction_closing_time': 1774884815.0, 'created_time': 1774343251.987423, 'last_price_update_time': 1774732023.965501}
2026-03-28 21:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UM17769') HTTP/1.1" 204 0
2026-03-28 21:07:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:04 [auto1.it] INFO: Found listing with ID: RE68635
2026-03-28 21:07:04 [auto1.it] INFO: Found listing with ID: HW61207
2026-03-28 21:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW61207%27 HTTP/1.1" 200 None
2026-03-28 21:07:04 [auto1.it] INFO: Scrape type for HW61207: 0
2026-03-28 21:07:04 [auto1.it] INFO: Found listing with ID: GA57810
2026-03-28 21:07:04 [auto1.it] INFO: Found listing with ID: VD70212
2026-03-28 21:07:04 [auto1.it] INFO: Found listing with ID: JK09197
2026-03-28 21:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK09197%27 HTTP/1.1" 200 None
2026-03-28 21:07:04 [auto1.it] INFO: Scrape type for JK09197: 0
2026-03-28 21:07:04 [auto1.it] INFO: Found listing with ID: CA31078
2026-03-28 21:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA31078%27 HTTP/1.1" 200 None
2026-03-28 21:07:04 [auto1.it] INFO: Scrape type for CA31078: 0
2026-03-28 21:07:04 [auto1.it] INFO: Found listing with ID: JS13846
2026-03-28 21:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS13846%27 HTTP/1.1" 200 None
2026-03-28 21:07:04 [auto1.it] INFO: Scrape type for JS13846: 0
2026-03-28 21:07:04 [auto1.it] INFO: Found listing with ID: JT98079
2026-03-28 21:07:04 [auto1.it] INFO: Found listing with ID: UN97193
2026-03-28 21:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AR18622/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:05 [scrapy.extensions.logstats] INFO: Crawled 100 pages (at 33 pages/min), scraped 100 items (at 56 items/min)
2026-03-28 21:07:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 166MiB
2026-03-28 21:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:05 [auto1.it] INFO: Channel: 24h | Page: 36 | totalHits: 2224 | hits on page: 40
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: ZN14128
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN14128%27 HTTP/1.1" 200 None
2026-03-28 21:07:05 [auto1.it] INFO: Scrape type for ZN14128: 0
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: HS75428
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: GA45330
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA45330%27 HTTP/1.1" 200 None
2026-03-28 21:07:05 [auto1.it] INFO: Scrape type for GA45330: 0
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: UU49973
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU49973%27 HTTP/1.1" 200 None
2026-03-28 21:07:05 [auto1.it] INFO: Scrape type for UU49973: 0
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: LR95961
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: WY28975
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: EB11724
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB11724%27 HTTP/1.1" 200 None
2026-03-28 21:07:05 [auto1.it] INFO: Scrape type for EB11724: 0
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: XP84134
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP84134%27 HTTP/1.1" 200 None
2026-03-28 21:07:05 [auto1.it] INFO: Scrape type for XP84134: 0
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: RV64880
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV64880%27 HTTP/1.1" 200 None
2026-03-28 21:07:05 [auto1.it] INFO: Scrape type for RV64880: 0
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: XH17321
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH17321%27 HTTP/1.1" 200 None
2026-03-28 21:07:05 [auto1.it] INFO: Scrape type for XH17321: 0
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: TG93645
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: ES64600
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES64600%27 HTTP/1.1" 200 None
2026-03-28 21:07:05 [auto1.it] INFO: Scrape type for ES64600: 0
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: XY26314
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: XJ87572
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: DV39460
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: BF34891
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BF34891%27 HTTP/1.1" 200 None
2026-03-28 21:07:05 [auto1.it] INFO: Scrape type for BF34891: 0
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: KV97590
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV97590%27 HTTP/1.1" 200 None
2026-03-28 21:07:05 [auto1.it] INFO: Scrape type for KV97590: 0
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: NT74531
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: CA25129
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: CP04601
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: PR97766
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: JF27717
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: DV62458
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: NP04036
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: RX07844
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX07844%27 HTTP/1.1" 200 None
2026-03-28 21:07:05 [auto1.it] INFO: Scrape type for RX07844: 0
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: LF46608
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LF46608%27 HTTP/1.1" 200 None
2026-03-28 21:07:05 [auto1.it] INFO: Scrape type for LF46608: 0
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: RZ99853
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: FF22275
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: TS59592
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: KT26389
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT26389%27 HTTP/1.1" 200 None
2026-03-28 21:07:05 [auto1.it] INFO: Scrape type for KT26389: 0
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: RU45122
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: NB02604
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB02604%27 HTTP/1.1" 200 None
2026-03-28 21:07:05 [auto1.it] INFO: Scrape type for NB02604: 0
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: GY05881
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: TT28559
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT28559%27 HTTP/1.1" 200 None
2026-03-28 21:07:05 [auto1.it] INFO: Scrape type for TT28559: 0
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: MY33245
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MY33245%27 HTTP/1.1" 200 None
2026-03-28 21:07:05 [auto1.it] INFO: Scrape type for MY33245: 0
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: BG42211
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG42211%27 HTTP/1.1" 200 None
2026-03-28 21:07:05 [auto1.it] INFO: Scrape type for BG42211: 0
2026-03-28 21:07:05 [auto1.it] INFO: Found listing with ID: BK04078
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BK04078%27 HTTP/1.1" 200 None
2026-03-28 21:07:05 [auto1.it] INFO: Scrape type for BK04078: 2
2026-03-28 21:07:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c338e97a-027c-5e36-b66e-eda398819535 with identifier: BK04078
2026-03-28 21:07:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c338e97a-027c-5e36-b66e-eda398819535 with scrape type 2
2026-03-28 21:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c338e97a-027c-5e36-b66e-eda398819535 with scrape type 2
2026-03-28 21:07:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c338e97a-027c-5e36-b66e-eda398819535, identifier: BK04078
2026-03-28 21:07:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c338e97a-027c-5e36-b66e-eda398819535 with identifier: BK04078
2026-03-28 21:07:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c338e97a-027c-5e36-b66e-eda398819535 with identifier: BK04078
2026-03-28 21:07:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c338e97a-027c-5e36-b66e-eda398819535 with identifier: BK04078 to the API
2026-03-28 21:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:58:21Z',
'fuel_type': 'diesel',
'id': 'c338e97a-027c-5e36-b66e-eda398819535',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK04078',
'listing': 'auction',
'make': 'BMW',
'model': 'X4',
'odometer': 195200,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-31',
'seller_name': None,
'title': 'BMW X4 xDrive 20d Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2018}
2026-03-28 21:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BK04078%27 HTTP/1.1" 200 None
2026-03-28 21:07:06 [auto1.it] INFO: Saving data for BK04078: {'auction_closing_time': 1774886301.0, 'created_time': 1774645547.140956, 'last_price_update_time': 1774732026.224756}
2026-03-28 21:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BK04078') HTTP/1.1" 204 0
2026-03-28 21:07:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:06 [auto1.it] INFO: Found listing with ID: AY46194
2026-03-28 21:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY46194%27 HTTP/1.1" 200 None
2026-03-28 21:07:06 [auto1.it] INFO: Scrape type for AY46194: 0
2026-03-28 21:07:06 [auto1.it] INFO: Found listing with ID: MW84295
2026-03-28 21:07:06 [auto1.it] INFO: Found listing with ID: ED17590
2026-03-28 21:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AR18622> (referer: https://www.auto1.com/v1/car-details-view/AR18622/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d334019-d677-56c0-881f-92f4cf9d2c6f with identifier: AR18622
2026-03-28 21:07:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d334019-d677-56c0-881f-92f4cf9d2c6f with scrape type 1
2026-03-28 21:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0d334019-d677-56c0-881f-92f4cf9d2c6f
2026-03-28 21:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F2f%252Ff12fbfad4f906f6ee189a0f5357744a8%252Fpa%252FAR18622_5aed5b716a2f47a786ae2fca9e4094f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_5aed5b716a2f47a786ae2fca9e4094f0.jpg not downloaded yet
2026-03-28 21:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F2f%252Ff12fbfad4f906f6ee189a0f5357744a8%252Fpa%252FAR18622_843af6c4a31759563c6951630727a011.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_843af6c4a31759563c6951630727a011.jpg not downloaded yet
2026-03-28 21:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F2f%252Ff12fbfad4f906f6ee189a0f5357744a8%252Fpa%252FAR18622_ca1a2c8db4dfdea977a1266efb363920.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_ca1a2c8db4dfdea977a1266efb363920.jpg not downloaded yet
2026-03-28 21:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F2f%252Ff12fbfad4f906f6ee189a0f5357744a8%252Fpa%252FAR18622_518d2eb82894501e04b15530719bbe8f.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_518d2eb82894501e04b15530719bbe8f.jpg not downloaded yet
2026-03-28 21:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F2f%252Ff12fbfad4f906f6ee189a0f5357744a8%252Fpa%252FAR18622_faa5df639c17060a0b8f0a26d97fbf2d.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_faa5df639c17060a0b8f0a26d97fbf2d.jpg not downloaded yet
2026-03-28 21:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F2f%252Ff12fbfad4f906f6ee189a0f5357744a8%252Fpa%252FAR18622_63dfdf2e4fed9dce5ec2f06efe1c0bd6.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_63dfdf2e4fed9dce5ec2f06efe1c0bd6.jpg not downloaded yet
2026-03-28 21:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F2f%252Ff12fbfad4f906f6ee189a0f5357744a8%252Fpa%252FAR18622_3c9e936725bd307bdf5716cff30fcf69.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_3c9e936725bd307bdf5716cff30fcf69.jpg not downloaded yet
2026-03-28 21:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F2f%252Ff12fbfad4f906f6ee189a0f5357744a8%252Fpa%252FAR18622_8229345044c171f2b024198ecd112cfe.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_8229345044c171f2b024198ecd112cfe.jpg not downloaded yet
2026-03-28 21:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F2f%252Ff12fbfad4f906f6ee189a0f5357744a8%252Fpa%252FAR18622_739a7de4a06237093bd4e425064cffea.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_739a7de4a06237093bd4e425064cffea.jpg not downloaded yet
2026-03-28 21:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F2f%252Ff12fbfad4f906f6ee189a0f5357744a8%252Fpa%252FAR18622_b7b1f24c526ce1e1f1e1882bf323f4cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_b7b1f24c526ce1e1f1e1882bf323f4cb.jpg not downloaded yet
2026-03-28 21:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_518d2eb82894501e04b15530719bbe8f.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_ca1a2c8db4dfdea977a1266efb363920.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_843af6c4a31759563c6951630727a011.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_63dfdf2e4fed9dce5ec2f06efe1c0bd6.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_3c9e936725bd307bdf5716cff30fcf69.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_faa5df639c17060a0b8f0a26d97fbf2d.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_5aed5b716a2f47a786ae2fca9e4094f0.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b935c7d10>
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F2f%252Ff12fbfad4f906f6ee189a0f5357744a8%252Fpa%252FAR18622_518d2eb82894501e04b15530719bbe8f.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_518d2eb82894501e04b15530719bbe8f.jpg saved to cache
2026-03-28 21:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d334019-d677-56c0-881f-92f4cf9d2c6f
2026-03-28 21:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_8229345044c171f2b024198ecd112cfe.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b843476d0>
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F2f%252Ff12fbfad4f906f6ee189a0f5357744a8%252Fpa%252FAR18622_ca1a2c8db4dfdea977a1266efb363920.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_ca1a2c8db4dfdea977a1266efb363920.jpg saved to cache
2026-03-28 21:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d334019-d677-56c0-881f-92f4cf9d2c6f
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84313f90>
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F2f%252Ff12fbfad4f906f6ee189a0f5357744a8%252Fpa%252FAR18622_843af6c4a31759563c6951630727a011.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_843af6c4a31759563c6951630727a011.jpg saved to cache
2026-03-28 21:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d334019-d677-56c0-881f-92f4cf9d2c6f
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8413c190>
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F2f%252Ff12fbfad4f906f6ee189a0f5357744a8%252Fpa%252FAR18622_63dfdf2e4fed9dce5ec2f06efe1c0bd6.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_63dfdf2e4fed9dce5ec2f06efe1c0bd6.jpg saved to cache
2026-03-28 21:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0d334019-d677-56c0-881f-92f4cf9d2c6f
2026-03-28 21:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_739a7de4a06237093bd4e425064cffea.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_b7b1f24c526ce1e1f1e1882bf323f4cb.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84320150>
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F2f%252Ff12fbfad4f906f6ee189a0f5357744a8%252Fpa%252FAR18622_3c9e936725bd307bdf5716cff30fcf69.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_3c9e936725bd307bdf5716cff30fcf69.jpg saved to cache
2026-03-28 21:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0d334019-d677-56c0-881f-92f4cf9d2c6f
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8439de50>
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F2f%252Ff12fbfad4f906f6ee189a0f5357744a8%252Fpa%252FAR18622_faa5df639c17060a0b8f0a26d97fbf2d.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_faa5df639c17060a0b8f0a26d97fbf2d.jpg saved to cache
2026-03-28 21:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d334019-d677-56c0-881f-92f4cf9d2c6f
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b842b5b50>
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F2f%252Ff12fbfad4f906f6ee189a0f5357744a8%252Fpa%252FAR18622_5aed5b716a2f47a786ae2fca9e4094f0.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_5aed5b716a2f47a786ae2fca9e4094f0.jpg saved to cache
2026-03-28 21:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d334019-d677-56c0-881f-92f4cf9d2c6f
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b843ac350>
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F2f%252Ff12fbfad4f906f6ee189a0f5357744a8%252Fpa%252FAR18622_8229345044c171f2b024198ecd112cfe.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_8229345044c171f2b024198ecd112cfe.jpg saved to cache
2026-03-28 21:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0d334019-d677-56c0-881f-92f4cf9d2c6f
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b842b7910>
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F2f%252Ff12fbfad4f906f6ee189a0f5357744a8%252Fpa%252FAR18622_739a7de4a06237093bd4e425064cffea.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_739a7de4a06237093bd4e425064cffea.jpg saved to cache
2026-03-28 21:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0d334019-d677-56c0-881f-92f4cf9d2c6f
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84288590>
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F2f%252Ff12fbfad4f906f6ee189a0f5357744a8%252Fpa%252FAR18622_b7b1f24c526ce1e1f1e1882bf323f4cb.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_b7b1f24c526ce1e1f1e1882bf323f4cb.jpg saved to cache
2026-03-28 21:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0d334019-d677-56c0-881f-92f4cf9d2c6f
2026-03-28 21:07:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d334019-d677-56c0-881f-92f4cf9d2c6f, skipping ID generation
2026-03-28 21:07:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d334019-d677-56c0-881f-92f4cf9d2c6f with scrape type 1
2026-03-28 21:07:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d334019-d677-56c0-881f-92f4cf9d2c6f sending to next pipeline
2026-03-28 21:07:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0d334019-d677-56c0-881f-92f4cf9d2c6f, identifier: AR18622
2026-03-28 21:07:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0d334019-d677-56c0-881f-92f4cf9d2c6f with identifier: AR18622
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 21:07:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 21:07:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0d334019-d677-56c0-881f-92f4cf9d2c6f with identifier: AR18622
2026-03-28 21:07:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0d334019-d677-56c0-881f-92f4cf9d2c6f with identifier: AR18622 to the API
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_b7b1f24c526ce1e1f1e1882bf323f4cb.jpg>
{'auction_title': '',
'c_o_2_emission_value': 170,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:54:36Z',
'fuel_type': 'diesel',
'id': '0d334019-d677-56c0-881f-92f4cf9d2c6f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR18622',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 166221,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65185,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_5aed5b716a2f47a786ae2fca9e4094f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58236,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_843af6c4a31759563c6951630727a011.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58226,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_ca1a2c8db4dfdea977a1266efb363920.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54550,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_518d2eb82894501e04b15530719bbe8f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61293,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_faa5df639c17060a0b8f0a26d97fbf2d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57808,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_63dfdf2e4fed9dce5ec2f06efe1c0bd6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54628,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_3c9e936725bd307bdf5716cff30fcf69.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69102,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_8229345044c171f2b024198ecd112cfe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66772,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_739a7de4a06237093bd4e425064cffea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56957,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_b7b1f24c526ce1e1f1e1882bf323f4cb.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-06-06',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Tucson 2.0 CRDi Xpossible 4WD',
'transmission': 'automatic',
'trim': 'Xpossible 4WD',
'year': 2016}
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR18622%27 HTTP/1.1" 200 None
2026-03-28 21:07:08 [auto1.it] INFO: Saving data for AR18622: {'created_time': 1774732028.049065, 'last_price_update_time': 1774732028.049077, 'auction_closing_time': 1774886076.0}
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AR18622') HTTP/1.1" 204 0
2026-03-28 21:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:08 [auto1.it] INFO: Channel: 24h | Page: 37 | totalHits: 2224 | hits on page: 40
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: GT34435
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: YY01932
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: VA29565
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VA29565%27 HTTP/1.1" 200 None
2026-03-28 21:07:08 [auto1.it] INFO: Scrape type for VA29565: 0
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: SC91639
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC91639%27 HTTP/1.1" 200 None
2026-03-28 21:07:08 [auto1.it] INFO: Scrape type for SC91639: 0
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: CH35422
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: BG55667
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG55667%27 HTTP/1.1" 200 None
2026-03-28 21:07:08 [auto1.it] INFO: Scrape type for BG55667: 0
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: PD51522
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD51522%27 HTTP/1.1" 200 None
2026-03-28 21:07:08 [auto1.it] INFO: Scrape type for PD51522: 0
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: FK45797
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK45797%27 HTTP/1.1" 200 None
2026-03-28 21:07:08 [auto1.it] INFO: Scrape type for FK45797: 0
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: AC52318
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AC52318%27 HTTP/1.1" 200 None
2026-03-28 21:07:08 [auto1.it] INFO: Scrape type for AC52318: 0
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: RA11036
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: DS09153
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS09153%27 HTTP/1.1" 200 None
2026-03-28 21:07:08 [auto1.it] INFO: Scrape type for DS09153: 0
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: TF37027
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF37027%27 HTTP/1.1" 200 None
2026-03-28 21:07:08 [auto1.it] INFO: Scrape type for TF37027: 0
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: DW71358
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: CA07197
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: XY19791
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY19791%27 HTTP/1.1" 200 None
2026-03-28 21:07:08 [auto1.it] INFO: Scrape type for XY19791: 0
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: AA46193
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: PP30320
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP30320%27 HTTP/1.1" 200 None
2026-03-28 21:07:08 [auto1.it] INFO: Scrape type for PP30320: 0
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: KA77498
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: FB26923
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: GW20586
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: WB02542
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB02542%27 HTTP/1.1" 200 None
2026-03-28 21:07:08 [auto1.it] INFO: Scrape type for WB02542: 0
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: PK39445
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK39445%27 HTTP/1.1" 200 None
2026-03-28 21:07:08 [auto1.it] INFO: Scrape type for PK39445: 0
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: DV74338
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV74338%27 HTTP/1.1" 200 None
2026-03-28 21:07:08 [auto1.it] INFO: Scrape type for DV74338: 0
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: XX93100
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: AM26734
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: SX21241
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: NC70942
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: AD83412
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD83412%27 HTTP/1.1" 200 None
2026-03-28 21:07:08 [auto1.it] INFO: Scrape type for AD83412: 0
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: HM03162
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: SK74491
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK74491%27 HTTP/1.1" 200 None
2026-03-28 21:07:08 [auto1.it] INFO: Scrape type for SK74491: 0
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: HL13838
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL13838%27 HTTP/1.1" 200 None
2026-03-28 21:07:08 [auto1.it] INFO: Scrape type for HL13838: 0
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: EA08863
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: LY98983
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: TZ05140
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ05140%27 HTTP/1.1" 200 None
2026-03-28 21:07:08 [auto1.it] INFO: Scrape type for TZ05140: 0
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: SP76043
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: TP07930
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: NJ20872
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: VF45343
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: UH24894
2026-03-28 21:07:08 [auto1.it] INFO: Found listing with ID: SB88786
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB88786%27 HTTP/1.1" 200 None
2026-03-28 21:07:08 [auto1.it] INFO: Scrape type for SB88786: 0
2026-03-28 21:07:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:09 [auto1.it] INFO: Channel: 24h | Page: 38 | totalHits: 2224 | hits on page: 40
2026-03-28 21:07:09 [auto1.it] INFO: Found listing with ID: CA11723
2026-03-28 21:07:09 [auto1.it] INFO: Found listing with ID: BA15195
2026-03-28 21:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA15195%27 HTTP/1.1" 200 None
2026-03-28 21:07:09 [auto1.it] INFO: Scrape type for BA15195: 0
2026-03-28 21:07:09 [auto1.it] INFO: Found listing with ID: UC27147
2026-03-28 21:07:09 [auto1.it] INFO: Found listing with ID: NT25208
2026-03-28 21:07:09 [auto1.it] INFO: Found listing with ID: FW75637
2026-03-28 21:07:09 [auto1.it] INFO: Found listing with ID: XK39914
2026-03-28 21:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK39914%27 HTTP/1.1" 200 None
2026-03-28 21:07:09 [auto1.it] INFO: Scrape type for XK39914: 0
2026-03-28 21:07:09 [auto1.it] INFO: Found listing with ID: FM41301
2026-03-28 21:07:09 [auto1.it] INFO: Found listing with ID: KN82468
2026-03-28 21:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KN82468%27 HTTP/1.1" 200 None
2026-03-28 21:07:09 [auto1.it] INFO: Scrape type for KN82468: 0
2026-03-28 21:07:09 [auto1.it] INFO: Found listing with ID: PT72554
2026-03-28 21:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT72554%27 HTTP/1.1" 200 None
2026-03-28 21:07:09 [auto1.it] INFO: Scrape type for PT72554: 2
2026-03-28 21:07:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1bbbcdc-6eb3-558b-9fdc-cde371ee35db with identifier: PT72554
2026-03-28 21:07:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1bbbcdc-6eb3-558b-9fdc-cde371ee35db with scrape type 2
2026-03-28 21:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1bbbcdc-6eb3-558b-9fdc-cde371ee35db with scrape type 2
2026-03-28 21:07:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e1bbbcdc-6eb3-558b-9fdc-cde371ee35db, identifier: PT72554
2026-03-28 21:07:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e1bbbcdc-6eb3-558b-9fdc-cde371ee35db with identifier: PT72554
2026-03-28 21:07:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e1bbbcdc-6eb3-558b-9fdc-cde371ee35db with identifier: PT72554
2026-03-28 21:07:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e1bbbcdc-6eb3-558b-9fdc-cde371ee35db with identifier: PT72554 to the API
2026-03-28 21:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:53:55Z',
'fuel_type': 'diesel',
'id': 'e1bbbcdc-6eb3-558b-9fdc-cde371ee35db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT72554',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 276514,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-28',
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2016}
2026-03-28 21:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT72554%27 HTTP/1.1" 200 None
2026-03-28 21:07:10 [auto1.it] INFO: Saving data for PT72554: {'auction_closing_time': 1774886035.0, 'created_time': 1774559213.41646, 'last_price_update_time': 1774732030.075138}
2026-03-28 21:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PT72554') HTTP/1.1" 204 0
2026-03-28 21:07:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:10 [auto1.it] INFO: Found listing with ID: SK80279
2026-03-28 21:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK80279%27 HTTP/1.1" 200 None
2026-03-28 21:07:10 [auto1.it] INFO: Scrape type for SK80279: 0
2026-03-28 21:07:10 [auto1.it] INFO: Found listing with ID: TP30919
2026-03-28 21:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP30919%27 HTTP/1.1" 200 None
2026-03-28 21:07:10 [auto1.it] INFO: Scrape type for TP30919: 0
2026-03-28 21:07:10 [auto1.it] INFO: Found listing with ID: DP98700
2026-03-28 21:07:10 [auto1.it] INFO: Found listing with ID: XT40512
2026-03-28 21:07:10 [auto1.it] INFO: Found listing with ID: BE00528
2026-03-28 21:07:10 [auto1.it] INFO: Found listing with ID: EE91281
2026-03-28 21:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE91281%27 HTTP/1.1" 200 None
2026-03-28 21:07:10 [auto1.it] INFO: Scrape type for EE91281: 2
2026-03-28 21:07:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e277313-b4d1-5058-a583-46677741c380 with identifier: EE91281
2026-03-28 21:07:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e277313-b4d1-5058-a583-46677741c380 with scrape type 2
2026-03-28 21:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e277313-b4d1-5058-a583-46677741c380 with scrape type 2
2026-03-28 21:07:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0e277313-b4d1-5058-a583-46677741c380, identifier: EE91281
2026-03-28 21:07:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0e277313-b4d1-5058-a583-46677741c380 with identifier: EE91281
2026-03-28 21:07:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0e277313-b4d1-5058-a583-46677741c380 with identifier: EE91281
2026-03-28 21:07:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0e277313-b4d1-5058-a583-46677741c380 with identifier: EE91281 to the API
2026-03-28 21:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 211,
'expiration_date': '2026-03-30T15:59:21Z',
'fuel_type': 'diesel',
'id': '0e277313-b4d1-5058-a583-46677741c380',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE91281',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 95819,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-14',
'seller_name': None,
'title': 'Volvo XC60 2.0 B4 Diesel Mild-Hybrid R Design AWD',
'transmission': 'automatic',
'trim': 'R Design AWD',
'year': 2019}
2026-03-28 21:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE91281%27 HTTP/1.1" 200 None
2026-03-28 21:07:10 [auto1.it] INFO: Saving data for EE91281: {'auction_closing_time': 1774886361.0, 'created_time': 1772177424.1569, 'last_price_update_time': 1774732030.655621}
2026-03-28 21:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EE91281') HTTP/1.1" 204 0
2026-03-28 21:07:10 [auto1.it] INFO: Found listing with ID: TX96321
2026-03-28 21:07:10 [auto1.it] INFO: Found listing with ID: RP23530
2026-03-28 21:07:10 [auto1.it] INFO: Found listing with ID: JC41210
2026-03-28 21:07:10 [auto1.it] INFO: Found listing with ID: KW78911
2026-03-28 21:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW78911%27 HTTP/1.1" 200 None
2026-03-28 21:07:10 [auto1.it] INFO: Scrape type for KW78911: 0
2026-03-28 21:07:10 [auto1.it] INFO: Found listing with ID: XX72461
2026-03-28 21:07:10 [auto1.it] INFO: Found listing with ID: AJ45475
2026-03-28 21:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ45475%27 HTTP/1.1" 200 None
2026-03-28 21:07:10 [auto1.it] INFO: Scrape type for AJ45475: 0
2026-03-28 21:07:10 [auto1.it] INFO: Found listing with ID: RB61179
2026-03-28 21:07:10 [auto1.it] INFO: Found listing with ID: RA46767
2026-03-28 21:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA46767%27 HTTP/1.1" 200 None
2026-03-28 21:07:10 [auto1.it] INFO: Scrape type for RA46767: 2
2026-03-28 21:07:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e60e859-b74d-5a66-a8cf-39713329101c with identifier: RA46767
2026-03-28 21:07:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e60e859-b74d-5a66-a8cf-39713329101c with scrape type 2
2026-03-28 21:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e60e859-b74d-5a66-a8cf-39713329101c with scrape type 2
2026-03-28 21:07:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7e60e859-b74d-5a66-a8cf-39713329101c, identifier: RA46767
2026-03-28 21:07:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7e60e859-b74d-5a66-a8cf-39713329101c with identifier: RA46767
2026-03-28 21:07:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7e60e859-b74d-5a66-a8cf-39713329101c with identifier: RA46767
2026-03-28 21:07:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7e60e859-b74d-5a66-a8cf-39713329101c with identifier: RA46767 to the API
2026-03-28 21:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:56:32Z',
'fuel_type': 'petrol',
'id': '7e60e859-b74d-5a66-a8cf-39713329101c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA46767',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'SLK-Klasse',
'odometer': 31598,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-06',
'seller_name': None,
'title': 'Mercedes-Benz SLK-Klasse SLK 250 BlueEfficiency',
'transmission': 'manual',
'trim': 'BlueEfficiency',
'year': 2015}
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA46767%27 HTTP/1.1" 200 None
2026-03-28 21:07:11 [auto1.it] INFO: Saving data for RA46767: {'auction_closing_time': 1774886192.0, 'created_time': 1773131428.363574, 'last_price_update_time': 1774732031.158154}
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RA46767') HTTP/1.1" 204 0
2026-03-28 21:07:11 [auto1.it] INFO: Found listing with ID: NK94790
2026-03-28 21:07:11 [auto1.it] INFO: Found listing with ID: GM28799
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM28799%27 HTTP/1.1" 200 None
2026-03-28 21:07:11 [auto1.it] INFO: Scrape type for GM28799: 0
2026-03-28 21:07:11 [auto1.it] INFO: Found listing with ID: GE08005
2026-03-28 21:07:11 [auto1.it] INFO: Found listing with ID: NP81459
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP81459%27 HTTP/1.1" 200 None
2026-03-28 21:07:11 [auto1.it] INFO: Scrape type for NP81459: 0
2026-03-28 21:07:11 [auto1.it] INFO: Found listing with ID: KD77242
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD77242%27 HTTP/1.1" 200 None
2026-03-28 21:07:11 [auto1.it] INFO: Scrape type for KD77242: 2
2026-03-28 21:07:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 685e1688-0a1e-5afd-9cde-47b4d0838a42 with identifier: KD77242
2026-03-28 21:07:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 685e1688-0a1e-5afd-9cde-47b4d0838a42 with scrape type 2
2026-03-28 21:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 685e1688-0a1e-5afd-9cde-47b4d0838a42 with scrape type 2
2026-03-28 21:07:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 685e1688-0a1e-5afd-9cde-47b4d0838a42, identifier: KD77242
2026-03-28 21:07:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 685e1688-0a1e-5afd-9cde-47b4d0838a42 with identifier: KD77242
2026-03-28 21:07:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 685e1688-0a1e-5afd-9cde-47b4d0838a42 with identifier: KD77242
2026-03-28 21:07:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 685e1688-0a1e-5afd-9cde-47b4d0838a42 with identifier: KD77242 to the API
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:19:14Z',
'fuel_type': 'petrol',
'id': '685e1688-0a1e-5afd-9cde-47b4d0838a42',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD77242',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 160943,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-06-13',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 200 Kompressor Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2007}
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD77242%27 HTTP/1.1" 200 None
2026-03-28 21:07:11 [auto1.it] INFO: Saving data for KD77242: {'auction_closing_time': 1774883954.0, 'created_time': 1774127298.684491, 'last_price_update_time': 1774732031.721864}
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KD77242') HTTP/1.1" 204 0
2026-03-28 21:07:11 [auto1.it] INFO: Found listing with ID: GR65234
2026-03-28 21:07:11 [auto1.it] INFO: Found listing with ID: BH96807
2026-03-28 21:07:11 [auto1.it] INFO: Found listing with ID: DZ90619
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ90619%27 HTTP/1.1" 200 None
2026-03-28 21:07:11 [auto1.it] INFO: Scrape type for DZ90619: 0
2026-03-28 21:07:11 [auto1.it] INFO: Found listing with ID: BT34353
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT34353%27 HTTP/1.1" 200 None
2026-03-28 21:07:11 [auto1.it] INFO: Scrape type for BT34353: 0
2026-03-28 21:07:11 [auto1.it] INFO: Found listing with ID: EV67651
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV67651%27 HTTP/1.1" 200 None
2026-03-28 21:07:11 [auto1.it] INFO: Scrape type for EV67651: 0
2026-03-28 21:07:11 [auto1.it] INFO: Found listing with ID: RT31033
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT31033%27 HTTP/1.1" 200 None
2026-03-28 21:07:11 [auto1.it] INFO: Scrape type for RT31033: 0
2026-03-28 21:07:11 [auto1.it] INFO: Found listing with ID: ZX88730
2026-03-28 21:07:11 [auto1.it] INFO: Found listing with ID: BT51990
2026-03-28 21:07:11 [auto1.it] INFO: Found listing with ID: GY24745
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY24745%27 HTTP/1.1" 200 None
2026-03-28 21:07:11 [auto1.it] INFO: Scrape type for GY24745: 0
2026-03-28 21:07:11 [auto1.it] INFO: Found listing with ID: DA14696
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA14696%27 HTTP/1.1" 200 None
2026-03-28 21:07:11 [auto1.it] INFO: Scrape type for DA14696: 0
2026-03-28 21:07:11 [auto1.it] INFO: Found listing with ID: KR27714
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR27714%27 HTTP/1.1" 200 None
2026-03-28 21:07:11 [auto1.it] INFO: Scrape type for KR27714: 0
2026-03-28 21:07:11 [auto1.it] INFO: Found listing with ID: BX71767
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BX71767%27 HTTP/1.1" 200 None
2026-03-28 21:07:11 [auto1.it] INFO: Scrape type for BX71767: 0
2026-03-28 21:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:13 [auto1.it] INFO: Channel: 24h | Page: 39 | totalHits: 2224 | hits on page: 40
2026-03-28 21:07:13 [auto1.it] INFO: Found listing with ID: NY71286
2026-03-28 21:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY71286%27 HTTP/1.1" 200 None
2026-03-28 21:07:13 [auto1.it] INFO: Scrape type for NY71286: 0
2026-03-28 21:07:13 [auto1.it] INFO: Found listing with ID: LN65398
2026-03-28 21:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN65398%27 HTTP/1.1" 200 None
2026-03-28 21:07:13 [auto1.it] INFO: Scrape type for LN65398: 2
2026-03-28 21:07:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9d9df4c-a07c-58fd-a869-16ed99d90ee5 with identifier: LN65398
2026-03-28 21:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9d9df4c-a07c-58fd-a869-16ed99d90ee5 with scrape type 2
2026-03-28 21:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9d9df4c-a07c-58fd-a869-16ed99d90ee5 with scrape type 2
2026-03-28 21:07:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d9d9df4c-a07c-58fd-a869-16ed99d90ee5, identifier: LN65398
2026-03-28 21:07:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d9d9df4c-a07c-58fd-a869-16ed99d90ee5 with identifier: LN65398
2026-03-28 21:07:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d9d9df4c-a07c-58fd-a869-16ed99d90ee5 with identifier: LN65398
2026-03-28 21:07:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d9d9df4c-a07c-58fd-a869-16ed99d90ee5 with identifier: LN65398 to the API
2026-03-28 21:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:27:56Z',
'fuel_type': 'diesel',
'id': 'd9d9df4c-a07c-58fd-a869-16ed99d90ee5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN65398',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 200376,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-29',
'seller_name': None,
'title': 'BMW 1er 116d',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN65398%27 HTTP/1.1" 200 None
2026-03-28 21:07:14 [auto1.it] INFO: Saving data for LN65398: {'auction_closing_time': 1774884476.0, 'created_time': 1774343190.584479, 'last_price_update_time': 1774732034.118537}
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LN65398') HTTP/1.1" 204 0
2026-03-28 21:07:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: HR92713
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: ZF40554
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: MK90568
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: FU47372
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: FG90237
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: SX13991
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: FF25963
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF25963%27 HTTP/1.1" 200 None
2026-03-28 21:07:14 [auto1.it] INFO: Scrape type for FF25963: 0
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: MK89859
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MK89859%27 HTTP/1.1" 200 None
2026-03-28 21:07:14 [auto1.it] INFO: Scrape type for MK89859: 2
2026-03-28 21:07:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e5d83fc-9a3c-5282-9293-4c42cc8611e8 with identifier: MK89859
2026-03-28 21:07:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e5d83fc-9a3c-5282-9293-4c42cc8611e8 with scrape type 2
2026-03-28 21:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e5d83fc-9a3c-5282-9293-4c42cc8611e8 with scrape type 2
2026-03-28 21:07:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8e5d83fc-9a3c-5282-9293-4c42cc8611e8, identifier: MK89859
2026-03-28 21:07:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8e5d83fc-9a3c-5282-9293-4c42cc8611e8 with identifier: MK89859
2026-03-28 21:07:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8e5d83fc-9a3c-5282-9293-4c42cc8611e8 with identifier: MK89859
2026-03-28 21:07:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8e5d83fc-9a3c-5282-9293-4c42cc8611e8 with identifier: MK89859 to the API
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:15:51Z',
'fuel_type': 'petrol',
'id': '8e5d83fc-9a3c-5282-9293-4c42cc8611e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK89859',
'listing': 'auction',
'make': 'DR',
'model': 'DR Evo 5',
'odometer': 22496,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-05-21',
'seller_name': None,
'title': 'DR DR Evo 5 1.6 DVVT',
'transmission': 'manual',
'trim': '',
'year': 2024}
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MK89859%27 HTTP/1.1" 200 None
2026-03-28 21:07:14 [auto1.it] INFO: Saving data for MK89859: {'auction_closing_time': 1774883751.0, 'created_time': 1774645571.636416, 'last_price_update_time': 1774732034.658211}
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MK89859') HTTP/1.1" 204 0
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: TT73216
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT73216%27 HTTP/1.1" 200 None
2026-03-28 21:07:14 [auto1.it] INFO: Scrape type for TT73216: 0
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: NT36373
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NT36373%27 HTTP/1.1" 200 None
2026-03-28 21:07:14 [auto1.it] INFO: Scrape type for NT36373: 0
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: VS63057
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: EU08042
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU08042%27 HTTP/1.1" 200 None
2026-03-28 21:07:14 [auto1.it] INFO: Scrape type for EU08042: 0
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: RT93241
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT93241%27 HTTP/1.1" 200 None
2026-03-28 21:07:14 [auto1.it] INFO: Scrape type for RT93241: 0
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: DM50235
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DM50235%27 HTTP/1.1" 200 None
2026-03-28 21:07:14 [auto1.it] INFO: Scrape type for DM50235: 0
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: KB99828
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: XY06195
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: WL39771
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL39771%27 HTTP/1.1" 200 None
2026-03-28 21:07:14 [auto1.it] INFO: Scrape type for WL39771: 0
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: AP47784
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP47784%27 HTTP/1.1" 200 None
2026-03-28 21:07:14 [auto1.it] INFO: Scrape type for AP47784: 0
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: ER28485
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER28485%27 HTTP/1.1" 200 None
2026-03-28 21:07:14 [auto1.it] INFO: Scrape type for ER28485: 0
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: GB11317
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: WY52867
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: RE49156
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: SS74594
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS74594%27 HTTP/1.1" 200 None
2026-03-28 21:07:14 [auto1.it] INFO: Scrape type for SS74594: 0
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: ZY29551
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: YR57836
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR57836%27 HTTP/1.1" 200 None
2026-03-28 21:07:14 [auto1.it] INFO: Scrape type for YR57836: 0
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: VS88689
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS88689%27 HTTP/1.1" 200 None
2026-03-28 21:07:14 [auto1.it] INFO: Scrape type for VS88689: 0
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: VB10041
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB10041%27 HTTP/1.1" 200 None
2026-03-28 21:07:14 [auto1.it] INFO: Scrape type for VB10041: 0
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: KE74592
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: MH63316
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH63316%27 HTTP/1.1" 200 None
2026-03-28 21:07:14 [auto1.it] INFO: Scrape type for MH63316: 0
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: NE32372
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: WG36727
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: AA65111
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: FG22478
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG22478%27 HTTP/1.1" 200 None
2026-03-28 21:07:14 [auto1.it] INFO: Scrape type for FG22478: 0
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: UE69721
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE69721%27 HTTP/1.1" 200 None
2026-03-28 21:07:14 [auto1.it] INFO: Scrape type for UE69721: 0
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: FD53627
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD53627%27 HTTP/1.1" 200 None
2026-03-28 21:07:14 [auto1.it] INFO: Scrape type for FD53627: 0
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: RZ31848
2026-03-28 21:07:14 [auto1.it] INFO: Found listing with ID: NY14439
2026-03-28 21:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY14439%27 HTTP/1.1" 200 None
2026-03-28 21:07:15 [auto1.it] INFO: Scrape type for NY14439: 2
2026-03-28 21:07:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d16f43ac-0fdb-5139-84a7-187fbe7cb9ec with identifier: NY14439
2026-03-28 21:07:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d16f43ac-0fdb-5139-84a7-187fbe7cb9ec with scrape type 2
2026-03-28 21:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d16f43ac-0fdb-5139-84a7-187fbe7cb9ec with scrape type 2
2026-03-28 21:07:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d16f43ac-0fdb-5139-84a7-187fbe7cb9ec, identifier: NY14439
2026-03-28 21:07:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d16f43ac-0fdb-5139-84a7-187fbe7cb9ec with identifier: NY14439
2026-03-28 21:07:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d16f43ac-0fdb-5139-84a7-187fbe7cb9ec with identifier: NY14439
2026-03-28 21:07:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d16f43ac-0fdb-5139-84a7-187fbe7cb9ec with identifier: NY14439 to the API
2026-03-28 21:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:38:34Z',
'fuel_type': 'petrol',
'id': 'd16f43ac-0fdb-5139-84a7-187fbe7cb9ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY14439',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 161288,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-30',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2014}
2026-03-28 21:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY14439%27 HTTP/1.1" 200 None
2026-03-28 21:07:15 [auto1.it] INFO: Saving data for NY14439: {'auction_closing_time': 1774885114.0, 'created_time': 1774645585.109974, 'last_price_update_time': 1774732035.41101}
2026-03-28 21:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NY14439') HTTP/1.1" 204 0
2026-03-28 21:07:15 [auto1.it] INFO: Found listing with ID: XH35372
2026-03-28 21:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH35372%27 HTTP/1.1" 200 None
2026-03-28 21:07:15 [auto1.it] INFO: Scrape type for XH35372: 2
2026-03-28 21:07:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22906561-b204-5eec-aa44-444011c6742a with identifier: XH35372
2026-03-28 21:07:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22906561-b204-5eec-aa44-444011c6742a with scrape type 2
2026-03-28 21:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22906561-b204-5eec-aa44-444011c6742a with scrape type 2
2026-03-28 21:07:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 22906561-b204-5eec-aa44-444011c6742a, identifier: XH35372
2026-03-28 21:07:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 22906561-b204-5eec-aa44-444011c6742a with identifier: XH35372
2026-03-28 21:07:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 22906561-b204-5eec-aa44-444011c6742a with identifier: XH35372
2026-03-28 21:07:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 22906561-b204-5eec-aa44-444011c6742a with identifier: XH35372 to the API
2026-03-28 21:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:56:18Z',
'fuel_type': 'diesel',
'id': '22906561-b204-5eec-aa44-444011c6742a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH35372',
'listing': 'auction',
'make': 'Peugeot',
'model': '508',
'odometer': 452415,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-27',
'seller_name': None,
'title': 'Peugeot 508 2.0 HDi Business-Line',
'transmission': 'manual',
'trim': 'Business-Line',
'year': 2012}
2026-03-28 21:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH35372%27 HTTP/1.1" 200 None
2026-03-28 21:07:15 [auto1.it] INFO: Saving data for XH35372: {'auction_closing_time': 1774886178.0, 'created_time': 1774645602.48525, 'last_price_update_time': 1774732035.925872}
2026-03-28 21:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XH35372') HTTP/1.1" 204 0
2026-03-28 21:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:16 [auto1.it] INFO: Channel: 24h | Page: 40 | totalHits: 2224 | hits on page: 40
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: YG79824
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: FA25945
2026-03-28 21:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA25945%27 HTTP/1.1" 200 None
2026-03-28 21:07:16 [auto1.it] INFO: Scrape type for FA25945: 0
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: JC61958
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: TP79080
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: VV53069
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: ZW88781
2026-03-28 21:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW88781%27 HTTP/1.1" 200 None
2026-03-28 21:07:16 [auto1.it] INFO: Scrape type for ZW88781: 1
2026-03-28 21:07:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: EX36920
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: RC55633
2026-03-28 21:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC55633%27 HTTP/1.1" 200 None
2026-03-28 21:07:16 [auto1.it] INFO: Scrape type for RC55633: 0
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: ZL56801
2026-03-28 21:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL56801%27 HTTP/1.1" 200 None
2026-03-28 21:07:16 [auto1.it] INFO: Scrape type for ZL56801: 0
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: DD75867
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: ZU32516
2026-03-28 21:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU32516%27 HTTP/1.1" 200 None
2026-03-28 21:07:16 [auto1.it] INFO: Scrape type for ZU32516: 0
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: FN89798
2026-03-28 21:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN89798%27 HTTP/1.1" 200 None
2026-03-28 21:07:16 [auto1.it] INFO: Scrape type for FN89798: 0
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: YY37168
2026-03-28 21:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY37168%27 HTTP/1.1" 200 None
2026-03-28 21:07:16 [auto1.it] INFO: Scrape type for YY37168: 0
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: MK47318
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: DF71809
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: PW61851
2026-03-28 21:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW61851%27 HTTP/1.1" 200 None
2026-03-28 21:07:16 [auto1.it] INFO: Scrape type for PW61851: 0
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: PN84990
2026-03-28 21:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN84990%27 HTTP/1.1" 200 None
2026-03-28 21:07:16 [auto1.it] INFO: Scrape type for PN84990: 0
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: JT10117
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: EV28185
2026-03-28 21:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EV28185%27 HTTP/1.1" 200 None
2026-03-28 21:07:16 [auto1.it] INFO: Scrape type for EV28185: 0
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: MG40784
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: UH10100
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: YX40722
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: HW99269
2026-03-28 21:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW99269%27 HTTP/1.1" 200 None
2026-03-28 21:07:16 [auto1.it] INFO: Scrape type for HW99269: 0
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: XV92434
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: KW23650
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: RE73183
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: EU31713
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: EK96047
2026-03-28 21:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK96047%27 HTTP/1.1" 200 None
2026-03-28 21:07:16 [auto1.it] INFO: Scrape type for EK96047: 0
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: SN24706
2026-03-28 21:07:16 [auto1.it] INFO: Found listing with ID: CT94493
2026-03-28 21:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT94493%27 HTTP/1.1" 200 None
2026-03-28 21:07:16 [auto1.it] INFO: Scrape type for CT94493: 2
2026-03-28 21:07:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b878ea8e-03ff-596d-b914-272ef98a5c7b with identifier: CT94493
2026-03-28 21:07:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b878ea8e-03ff-596d-b914-272ef98a5c7b with scrape type 2
2026-03-28 21:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b878ea8e-03ff-596d-b914-272ef98a5c7b with scrape type 2
2026-03-28 21:07:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b878ea8e-03ff-596d-b914-272ef98a5c7b, identifier: CT94493
2026-03-28 21:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b878ea8e-03ff-596d-b914-272ef98a5c7b with identifier: CT94493
2026-03-28 21:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b878ea8e-03ff-596d-b914-272ef98a5c7b with identifier: CT94493
2026-03-28 21:07:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b878ea8e-03ff-596d-b914-272ef98a5c7b with identifier: CT94493 to the API
2026-03-28 21:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:11:22Z',
'fuel_type': 'diesel',
'id': 'b878ea8e-03ff-596d-b914-272ef98a5c7b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT94493',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 85113,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-04-08',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 CDI Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2010}
2026-03-28 21:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT94493%27 HTTP/1.1" 200 None
2026-03-28 21:07:17 [auto1.it] INFO: Saving data for CT94493: {'auction_closing_time': 1774883482.0, 'created_time': 1774645625.158367, 'last_price_update_time': 1774732037.475308}
2026-03-28 21:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CT94493') HTTP/1.1" 204 0
2026-03-28 21:07:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:17 [auto1.it] INFO: Found listing with ID: HW38972
2026-03-28 21:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW38972%27 HTTP/1.1" 200 None
2026-03-28 21:07:17 [auto1.it] INFO: Scrape type for HW38972: 0
2026-03-28 21:07:17 [auto1.it] INFO: Found listing with ID: NV14531
2026-03-28 21:07:17 [auto1.it] INFO: Found listing with ID: XW45727
2026-03-28 21:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW45727%27 HTTP/1.1" 200 None
2026-03-28 21:07:17 [auto1.it] INFO: Scrape type for XW45727: 0
2026-03-28 21:07:17 [auto1.it] INFO: Found listing with ID: WJ96008
2026-03-28 21:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ96008%27 HTTP/1.1" 200 None
2026-03-28 21:07:17 [auto1.it] INFO: Scrape type for WJ96008: 0
2026-03-28 21:07:17 [auto1.it] INFO: Found listing with ID: EA99644
2026-03-28 21:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA99644%27 HTTP/1.1" 200 None
2026-03-28 21:07:17 [auto1.it] INFO: Scrape type for EA99644: 0
2026-03-28 21:07:17 [auto1.it] INFO: Found listing with ID: NH43496
2026-03-28 21:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH43496%27 HTTP/1.1" 200 None
2026-03-28 21:07:17 [auto1.it] INFO: Scrape type for NH43496: 2
2026-03-28 21:07:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05ceb78f-322c-5d84-8ed4-8af761de60a6 with identifier: NH43496
2026-03-28 21:07:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05ceb78f-322c-5d84-8ed4-8af761de60a6 with scrape type 2
2026-03-28 21:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05ceb78f-322c-5d84-8ed4-8af761de60a6 with scrape type 2
2026-03-28 21:07:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 05ceb78f-322c-5d84-8ed4-8af761de60a6, identifier: NH43496
2026-03-28 21:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 05ceb78f-322c-5d84-8ed4-8af761de60a6 with identifier: NH43496
2026-03-28 21:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 05ceb78f-322c-5d84-8ed4-8af761de60a6 with identifier: NH43496
2026-03-28 21:07:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 05ceb78f-322c-5d84-8ed4-8af761de60a6 with identifier: NH43496 to the API
2026-03-28 21:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:26:29Z',
'fuel_type': 'diesel',
'id': '05ceb78f-322c-5d84-8ed4-8af761de60a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH43496',
'listing': 'auction',
'make': 'Nissan',
'model': 'Juke',
'odometer': 191025,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-05',
'seller_name': None,
'title': 'Nissan Juke 1.5 Turbodiesel Tekna',
'transmission': 'manual',
'trim': 'Tekna',
'year': 2015}
2026-03-28 21:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH43496%27 HTTP/1.1" 200 None
2026-03-28 21:07:18 [auto1.it] INFO: Saving data for NH43496: {'auction_closing_time': 1774884389.0, 'created_time': 1774645610.123164, 'last_price_update_time': 1774732038.085649}
2026-03-28 21:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NH43496') HTTP/1.1" 204 0
2026-03-28 21:07:18 [auto1.it] INFO: Found listing with ID: LR80545
2026-03-28 21:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR80545%27 HTTP/1.1" 200 None
2026-03-28 21:07:18 [auto1.it] INFO: Scrape type for LR80545: 0
2026-03-28 21:07:18 [auto1.it] INFO: Found listing with ID: KM03539
2026-03-28 21:07:18 [auto1.it] INFO: Found listing with ID: SD99760
2026-03-28 21:07:18 [auto1.it] INFO: Found listing with ID: YA38395
2026-03-28 21:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA38395%27 HTTP/1.1" 200 None
2026-03-28 21:07:18 [auto1.it] INFO: Scrape type for YA38395: 0
2026-03-28 21:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZW88781/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:19 [auto1.it] INFO: Channel: 24h | Page: 41 | totalHits: 2224 | hits on page: 40
2026-03-28 21:07:19 [auto1.it] INFO: Found listing with ID: UV23225
2026-03-28 21:07:19 [auto1.it] INFO: Found listing with ID: ST06974
2026-03-28 21:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST06974%27 HTTP/1.1" 200 None
2026-03-28 21:07:19 [auto1.it] INFO: Scrape type for ST06974: 0
2026-03-28 21:07:19 [auto1.it] INFO: Found listing with ID: AF86061
2026-03-28 21:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF86061%27 HTTP/1.1" 200 None
2026-03-28 21:07:19 [auto1.it] INFO: Scrape type for AF86061: 0
2026-03-28 21:07:19 [auto1.it] INFO: Found listing with ID: HH71659
2026-03-28 21:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH71659%27 HTTP/1.1" 200 None
2026-03-28 21:07:19 [auto1.it] INFO: Scrape type for HH71659: 2
2026-03-28 21:07:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efb4b89d-b764-583e-8926-f731a3c5da1d with identifier: HH71659
2026-03-28 21:07:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efb4b89d-b764-583e-8926-f731a3c5da1d with scrape type 2
2026-03-28 21:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efb4b89d-b764-583e-8926-f731a3c5da1d with scrape type 2
2026-03-28 21:07:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: efb4b89d-b764-583e-8926-f731a3c5da1d, identifier: HH71659
2026-03-28 21:07:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: efb4b89d-b764-583e-8926-f731a3c5da1d with identifier: HH71659
2026-03-28 21:07:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: efb4b89d-b764-583e-8926-f731a3c5da1d with identifier: HH71659
2026-03-28 21:07:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: efb4b89d-b764-583e-8926-f731a3c5da1d with identifier: HH71659 to the API
2026-03-28 21:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:02:56Z',
'fuel_type': 'petrol',
'id': 'efb4b89d-b764-583e-8926-f731a3c5da1d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH71659',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka',
'odometer': 134397,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-18',
'seller_name': None,
'title': 'Opel Mokka 1.6 Ego ecoFlex',
'transmission': 'manual',
'trim': 'Ego ecoFlex',
'year': 2013}
2026-03-28 21:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH71659%27 HTTP/1.1" 200 None
2026-03-28 21:07:19 [auto1.it] INFO: Saving data for HH71659: {'auction_closing_time': 1774882976.0, 'created_time': 1774533981.171215, 'last_price_update_time': 1774732039.712681}
2026-03-28 21:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HH71659') HTTP/1.1" 204 0
2026-03-28 21:07:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:19 [auto1.it] INFO: Found listing with ID: HA74709
2026-03-28 21:07:19 [auto1.it] INFO: Found listing with ID: XW11581
2026-03-28 21:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW11581%27 HTTP/1.1" 200 None
2026-03-28 21:07:19 [auto1.it] INFO: Scrape type for XW11581: 2
2026-03-28 21:07:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adca7d70-4a05-58ef-a172-57d572914c6e with identifier: XW11581
2026-03-28 21:07:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adca7d70-4a05-58ef-a172-57d572914c6e with scrape type 2
2026-03-28 21:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adca7d70-4a05-58ef-a172-57d572914c6e with scrape type 2
2026-03-28 21:07:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: adca7d70-4a05-58ef-a172-57d572914c6e, identifier: XW11581
2026-03-28 21:07:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: adca7d70-4a05-58ef-a172-57d572914c6e with identifier: XW11581
2026-03-28 21:07:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: adca7d70-4a05-58ef-a172-57d572914c6e with identifier: XW11581
2026-03-28 21:07:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: adca7d70-4a05-58ef-a172-57d572914c6e with identifier: XW11581 to the API
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:12:53Z',
'fuel_type': 'diesel',
'id': 'adca7d70-4a05-58ef-a172-57d572914c6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW11581',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 97746,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-19',
'seller_name': None,
'title': 'Audi A4 2.0 TDI quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2017}
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW11581%27 HTTP/1.1" 200 None
2026-03-28 21:07:20 [auto1.it] INFO: Saving data for XW11581: {'auction_closing_time': 1774883573.0, 'created_time': 1774533982.116834, 'last_price_update_time': 1774732040.232174}
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XW11581') HTTP/1.1" 204 0
2026-03-28 21:07:20 [auto1.it] INFO: Found listing with ID: JD36680
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD36680%27 HTTP/1.1" 200 None
2026-03-28 21:07:20 [auto1.it] INFO: Scrape type for JD36680: 0
2026-03-28 21:07:20 [auto1.it] INFO: Found listing with ID: SM56678
2026-03-28 21:07:20 [auto1.it] INFO: Found listing with ID: FV08764
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV08764%27 HTTP/1.1" 200 None
2026-03-28 21:07:20 [auto1.it] INFO: Scrape type for FV08764: 2
2026-03-28 21:07:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05a81c3a-14cf-513d-a1e7-d8ddb2c09173 with identifier: FV08764
2026-03-28 21:07:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05a81c3a-14cf-513d-a1e7-d8ddb2c09173 with scrape type 2
2026-03-28 21:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05a81c3a-14cf-513d-a1e7-d8ddb2c09173 with scrape type 2
2026-03-28 21:07:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 05a81c3a-14cf-513d-a1e7-d8ddb2c09173, identifier: FV08764
2026-03-28 21:07:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 05a81c3a-14cf-513d-a1e7-d8ddb2c09173 with identifier: FV08764
2026-03-28 21:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 05a81c3a-14cf-513d-a1e7-d8ddb2c09173 with identifier: FV08764
2026-03-28 21:07:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 05a81c3a-14cf-513d-a1e7-d8ddb2c09173 with identifier: FV08764 to the API
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:45:21Z',
'fuel_type': 'petrol',
'id': '05a81c3a-14cf-513d-a1e7-d8ddb2c09173',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV08764',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 260108,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-11-12',
'seller_name': None,
'title': 'Nissan Qashqai 1.6 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2008}
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV08764%27 HTTP/1.1" 200 None
2026-03-28 21:07:20 [auto1.it] INFO: Saving data for FV08764: {'auction_closing_time': 1774885521.0, 'created_time': 1774559152.260223, 'last_price_update_time': 1774732040.665451}
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FV08764') HTTP/1.1" 204 0
2026-03-28 21:07:20 [auto1.it] INFO: Found listing with ID: ZP43872
2026-03-28 21:07:20 [auto1.it] INFO: Found listing with ID: NT87512
2026-03-28 21:07:20 [auto1.it] INFO: Found listing with ID: BR85251
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR85251%27 HTTP/1.1" 200 None
2026-03-28 21:07:20 [auto1.it] INFO: Scrape type for BR85251: 0
2026-03-28 21:07:20 [auto1.it] INFO: Found listing with ID: HK76451
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK76451%27 HTTP/1.1" 200 None
2026-03-28 21:07:20 [auto1.it] INFO: Scrape type for HK76451: 0
2026-03-28 21:07:20 [auto1.it] INFO: Found listing with ID: MJ56549
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ56549%27 HTTP/1.1" 200 None
2026-03-28 21:07:20 [auto1.it] INFO: Scrape type for MJ56549: 0
2026-03-28 21:07:20 [auto1.it] INFO: Found listing with ID: JZ41811
2026-03-28 21:07:20 [auto1.it] INFO: Found listing with ID: GT53480
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT53480%27 HTTP/1.1" 200 None
2026-03-28 21:07:20 [auto1.it] INFO: Scrape type for GT53480: 0
2026-03-28 21:07:20 [auto1.it] INFO: Found listing with ID: RF78298
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF78298%27 HTTP/1.1" 200 None
2026-03-28 21:07:20 [auto1.it] INFO: Scrape type for RF78298: 0
2026-03-28 21:07:20 [auto1.it] INFO: Found listing with ID: CN60691
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN60691%27 HTTP/1.1" 200 None
2026-03-28 21:07:20 [auto1.it] INFO: Scrape type for CN60691: 0
2026-03-28 21:07:20 [auto1.it] INFO: Found listing with ID: FE23339
2026-03-28 21:07:20 [auto1.it] INFO: Found listing with ID: CM50151
2026-03-28 21:07:20 [auto1.it] INFO: Found listing with ID: ZA31579
2026-03-28 21:07:20 [auto1.it] INFO: Found listing with ID: VG20766
2026-03-28 21:07:20 [auto1.it] INFO: Found listing with ID: ZJ39070
2026-03-28 21:07:20 [auto1.it] INFO: Found listing with ID: AZ05187
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ05187%27 HTTP/1.1" 200 None
2026-03-28 21:07:20 [auto1.it] INFO: Scrape type for AZ05187: 0
2026-03-28 21:07:20 [auto1.it] INFO: Found listing with ID: NF08896
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF08896%27 HTTP/1.1" 200 None
2026-03-28 21:07:20 [auto1.it] INFO: Scrape type for NF08896: 2
2026-03-28 21:07:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7528b9ea-cf60-51f1-91b1-07abc2e9e2f6 with identifier: NF08896
2026-03-28 21:07:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7528b9ea-cf60-51f1-91b1-07abc2e9e2f6 with scrape type 2
2026-03-28 21:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7528b9ea-cf60-51f1-91b1-07abc2e9e2f6 with scrape type 2
2026-03-28 21:07:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7528b9ea-cf60-51f1-91b1-07abc2e9e2f6, identifier: NF08896
2026-03-28 21:07:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7528b9ea-cf60-51f1-91b1-07abc2e9e2f6 with identifier: NF08896
2026-03-28 21:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7528b9ea-cf60-51f1-91b1-07abc2e9e2f6 with identifier: NF08896
2026-03-28 21:07:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7528b9ea-cf60-51f1-91b1-07abc2e9e2f6 with identifier: NF08896 to the API
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:18:09Z',
'fuel_type': 'petrol',
'id': '7528b9ea-cf60-51f1-91b1-07abc2e9e2f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF08896',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 147280,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-12-21',
'seller_name': None,
'title': 'Volkswagen Golf V 1.6 Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2005}
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF08896%27 HTTP/1.1" 200 None
2026-03-28 21:07:21 [auto1.it] INFO: Saving data for NF08896: {'auction_closing_time': 1774883889.0, 'created_time': 1773131554.349027, 'last_price_update_time': 1774732041.257035}
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NF08896') HTTP/1.1" 204 0
2026-03-28 21:07:21 [auto1.it] INFO: Found listing with ID: CD59495
2026-03-28 21:07:21 [auto1.it] INFO: Found listing with ID: YW53472
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW53472%27 HTTP/1.1" 200 None
2026-03-28 21:07:21 [auto1.it] INFO: Scrape type for YW53472: 0
2026-03-28 21:07:21 [auto1.it] INFO: Found listing with ID: VY80184
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY80184%27 HTTP/1.1" 200 None
2026-03-28 21:07:21 [auto1.it] INFO: Scrape type for VY80184: 0
2026-03-28 21:07:21 [auto1.it] INFO: Found listing with ID: TH88339
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH88339%27 HTTP/1.1" 200 None
2026-03-28 21:07:21 [auto1.it] INFO: Scrape type for TH88339: 0
2026-03-28 21:07:21 [auto1.it] INFO: Found listing with ID: PX04626
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PX04626%27 HTTP/1.1" 200 None
2026-03-28 21:07:21 [auto1.it] INFO: Scrape type for PX04626: 0
2026-03-28 21:07:21 [auto1.it] INFO: Found listing with ID: HS43445
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HS43445%27 HTTP/1.1" 200 None
2026-03-28 21:07:21 [auto1.it] INFO: Scrape type for HS43445: 0
2026-03-28 21:07:21 [auto1.it] INFO: Found listing with ID: ER97620
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER97620%27 HTTP/1.1" 200 None
2026-03-28 21:07:21 [auto1.it] INFO: Scrape type for ER97620: 2
2026-03-28 21:07:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4297c06e-8ad1-5b05-bffe-b17b3903f553 with identifier: ER97620
2026-03-28 21:07:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4297c06e-8ad1-5b05-bffe-b17b3903f553 with scrape type 2
2026-03-28 21:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4297c06e-8ad1-5b05-bffe-b17b3903f553 with scrape type 2
2026-03-28 21:07:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4297c06e-8ad1-5b05-bffe-b17b3903f553, identifier: ER97620
2026-03-28 21:07:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4297c06e-8ad1-5b05-bffe-b17b3903f553 with identifier: ER97620
2026-03-28 21:07:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4297c06e-8ad1-5b05-bffe-b17b3903f553 with identifier: ER97620
2026-03-28 21:07:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4297c06e-8ad1-5b05-bffe-b17b3903f553 with identifier: ER97620 to the API
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:41:35Z',
'fuel_type': 'diesel',
'id': '4297c06e-8ad1-5b05-bffe-b17b3903f553',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER97620',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 164825,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-26',
'seller_name': None,
'title': 'MINI Cooper D',
'transmission': 'manual',
'trim': '',
'year': 2015}
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ER97620%27 HTTP/1.1" 200 None
2026-03-28 21:07:21 [auto1.it] INFO: Saving data for ER97620: {'auction_closing_time': 1774885295.0, 'created_time': 1774645636.848222, 'last_price_update_time': 1774732041.887621}
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ER97620') HTTP/1.1" 204 0
2026-03-28 21:07:21 [auto1.it] INFO: Found listing with ID: DL31507
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL31507%27 HTTP/1.1" 200 None
2026-03-28 21:07:21 [auto1.it] INFO: Scrape type for DL31507: 0
2026-03-28 21:07:21 [auto1.it] INFO: Found listing with ID: PH25620
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PH25620%27 HTTP/1.1" 200 None
2026-03-28 21:07:21 [auto1.it] INFO: Scrape type for PH25620: 0
2026-03-28 21:07:21 [auto1.it] INFO: Found listing with ID: AD96495
2026-03-28 21:07:21 [auto1.it] INFO: Found listing with ID: YP66201
2026-03-28 21:07:21 [auto1.it] INFO: Found listing with ID: LN67507
2026-03-28 21:07:21 [auto1.it] INFO: Found listing with ID: GZ47839
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ47839%27 HTTP/1.1" 200 None
2026-03-28 21:07:21 [auto1.it] INFO: Scrape type for GZ47839: 0
2026-03-28 21:07:21 [auto1.it] INFO: Found listing with ID: AR03634
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR03634%27 HTTP/1.1" 200 None
2026-03-28 21:07:21 [auto1.it] INFO: Scrape type for AR03634: 0
2026-03-28 21:07:21 [auto1.it] INFO: Found listing with ID: BW07837
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW07837%27 HTTP/1.1" 200 None
2026-03-28 21:07:21 [auto1.it] INFO: Scrape type for BW07837: 0
2026-03-28 21:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZW88781> (referer: https://www.auto1.com/v1/car-details-view/ZW88781/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 640f6d64-0417-5762-9bfa-1e6c60f98054 with identifier: ZW88781
2026-03-28 21:07:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 640f6d64-0417-5762-9bfa-1e6c60f98054 with scrape type 1
2026-03-28 21:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 640f6d64-0417-5762-9bfa-1e6c60f98054
2026-03-28 21:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fea%252Ff1eae29d66448e7fdef5238c4613563c%252Fpa%252FZW88781_41e8cda4f7bee5097b8b99b7686fe063.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ea/f1eae29d66448e7fdef5238c4613563c/pa/ZW88781_41e8cda4f7bee5097b8b99b7686fe063.jpg already downloaded
2026-03-28 21:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fea%252Ff1eae29d66448e7fdef5238c4613563c%252Fpa%252FZW88781_3a6ed5d6d8237ad7c0db6b192b526978.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ea/f1eae29d66448e7fdef5238c4613563c/pa/ZW88781_3a6ed5d6d8237ad7c0db6b192b526978.jpg already downloaded
2026-03-28 21:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fea%252Ff1eae29d66448e7fdef5238c4613563c%252Fpa%252FZW88781_2b3700aa88c6f65db58335efe5dcfd4d.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ea/f1eae29d66448e7fdef5238c4613563c/pa/ZW88781_2b3700aa88c6f65db58335efe5dcfd4d.jpg already downloaded
2026-03-28 21:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fea%252Ff1eae29d66448e7fdef5238c4613563c%252Fpa%252FZW88781_7a7e0bfc6f4e90f7db9c00e9e58d1dc7.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ea/f1eae29d66448e7fdef5238c4613563c/pa/ZW88781_7a7e0bfc6f4e90f7db9c00e9e58d1dc7.jpg already downloaded
2026-03-28 21:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fea%252Ff1eae29d66448e7fdef5238c4613563c%252Fpa%252FZW88781_ba1c51ac7e2971da0189fea9ed168985.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/ea/f1eae29d66448e7fdef5238c4613563c/pa/ZW88781_ba1c51ac7e2971da0189fea9ed168985.jpg already downloaded
2026-03-28 21:07:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 640f6d64-0417-5762-9bfa-1e6c60f98054, identifier: ZW88781
2026-03-28 21:07:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 640f6d64-0417-5762-9bfa-1e6c60f98054 with identifier: ZW88781
2026-03-28 21:07:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 640f6d64-0417-5762-9bfa-1e6c60f98054 with identifier: ZW88781
2026-03-28 21:07:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 640f6d64-0417-5762-9bfa-1e6c60f98054 with identifier: ZW88781 to the API
2026-03-28 21:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZW88781>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '',
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:48:43Z',
'fuel_type': 'diesel',
'id': '640f6d64-0417-5762-9bfa-1e6c60f98054',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW88781',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Suzuki',
'model': 'SX4',
'odometer': 151677,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/imgf1/ea/f1eae29d66448e7fdef5238c4613563c/pa/ZW88781_41e8cda4f7bee5097b8b99b7686fe063.jpg',
'https://img-pa.auto1.com/imgf1/ea/f1eae29d66448e7fdef5238c4613563c/pa/ZW88781_3a6ed5d6d8237ad7c0db6b192b526978.jpg',
'https://img-pa.auto1.com/imgf1/ea/f1eae29d66448e7fdef5238c4613563c/pa/ZW88781_2b3700aa88c6f65db58335efe5dcfd4d.jpg',
'https://img-pa.auto1.com/imgf1/ea/f1eae29d66448e7fdef5238c4613563c/pa/ZW88781_7a7e0bfc6f4e90f7db9c00e9e58d1dc7.jpg',
'https://img-pa.auto1.com/imgf1/ea/f1eae29d66448e7fdef5238c4613563c/pa/ZW88781_ba1c51ac7e2971da0189fea9ed168985.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_640f6d64-0417-5762-9bfa-1e6c60f98054/640f6d64-0417-5762-9bfa-1e6c60f98054_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79073,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/ea/f1eae29d66448e7fdef5238c4613563c/pa/ZW88781_41e8cda4f7bee5097b8b99b7686fe063.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_640f6d64-0417-5762-9bfa-1e6c60f98054/640f6d64-0417-5762-9bfa-1e6c60f98054_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73324,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/ea/f1eae29d66448e7fdef5238c4613563c/pa/ZW88781_3a6ed5d6d8237ad7c0db6b192b526978.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_640f6d64-0417-5762-9bfa-1e6c60f98054/640f6d64-0417-5762-9bfa-1e6c60f98054_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74175,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/ea/f1eae29d66448e7fdef5238c4613563c/pa/ZW88781_2b3700aa88c6f65db58335efe5dcfd4d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_640f6d64-0417-5762-9bfa-1e6c60f98054/640f6d64-0417-5762-9bfa-1e6c60f98054_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59548,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/ea/f1eae29d66448e7fdef5238c4613563c/pa/ZW88781_7a7e0bfc6f4e90f7db9c00e9e58d1dc7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_640f6d64-0417-5762-9bfa-1e6c60f98054/640f6d64-0417-5762-9bfa-1e6c60f98054_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75489,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/ea/f1eae29d66448e7fdef5238c4613563c/pa/ZW88781_ba1c51ac7e2971da0189fea9ed168985.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-07-22',
'seats_number': 5,
'seller_name': None,
'title': 'Suzuki SX4 1.6 DDiS Club/Outdoorline',
'transmission': 'manual',
'trim': 'Club/Outdoorline',
'year': 2010}
2026-03-28 21:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZW88781%27 HTTP/1.1" 200 None
2026-03-28 21:07:22 [auto1.it] INFO: Saving data for ZW88781: {'created_time': 1774732042.65712, 'last_price_update_time': 1774732042.657132, 'auction_closing_time': 1774885723.0}
2026-03-28 21:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZW88781') HTTP/1.1" 204 0
2026-03-28 21:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:22 [auto1.it] INFO: Channel: 24h | Page: 42 | totalHits: 2224 | hits on page: 40
2026-03-28 21:07:22 [auto1.it] INFO: Found listing with ID: TL02319
2026-03-28 21:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL02319%27 HTTP/1.1" 200 None
2026-03-28 21:07:22 [auto1.it] INFO: Scrape type for TL02319: 0
2026-03-28 21:07:22 [auto1.it] INFO: Found listing with ID: XE78357
2026-03-28 21:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE78357%27 HTTP/1.1" 200 None
2026-03-28 21:07:22 [auto1.it] INFO: Scrape type for XE78357: 0
2026-03-28 21:07:22 [auto1.it] INFO: Found listing with ID: MX32120
2026-03-28 21:07:22 [auto1.it] INFO: Found listing with ID: XZ55537
2026-03-28 21:07:22 [auto1.it] INFO: Found listing with ID: WS94048
2026-03-28 21:07:22 [auto1.it] INFO: Found listing with ID: FE63733
2026-03-28 21:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FE63733%27 HTTP/1.1" 200 None
2026-03-28 21:07:22 [auto1.it] INFO: Scrape type for FE63733: 2
2026-03-28 21:07:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f2dc262-d919-54aa-b0c7-f58c79d69490 with identifier: FE63733
2026-03-28 21:07:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f2dc262-d919-54aa-b0c7-f58c79d69490 with scrape type 2
2026-03-28 21:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f2dc262-d919-54aa-b0c7-f58c79d69490 with scrape type 2
2026-03-28 21:07:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9f2dc262-d919-54aa-b0c7-f58c79d69490, identifier: FE63733
2026-03-28 21:07:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9f2dc262-d919-54aa-b0c7-f58c79d69490 with identifier: FE63733
2026-03-28 21:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9f2dc262-d919-54aa-b0c7-f58c79d69490 with identifier: FE63733
2026-03-28 21:07:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9f2dc262-d919-54aa-b0c7-f58c79d69490 with identifier: FE63733 to the API
2026-03-28 21:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:25:55Z',
'fuel_type': 'diesel',
'id': '9f2dc262-d919-54aa-b0c7-f58c79d69490',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE63733',
'listing': 'auction',
'make': 'Fiat',
'model': 'Tipo',
'odometer': 95174,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-11',
'seller_name': None,
'title': 'Fiat Tipo 1.3 M-Jet Easy',
'transmission': 'manual',
'trim': 'Easy',
'year': 2019}
2026-03-28 21:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FE63733%27 HTTP/1.1" 200 None
2026-03-28 21:07:23 [auto1.it] INFO: Saving data for FE63733: {'auction_closing_time': 1774884355.0, 'created_time': 1774343229.114832, 'last_price_update_time': 1774732043.347863}
2026-03-28 21:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FE63733') HTTP/1.1" 204 0
2026-03-28 21:07:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:23 [auto1.it] INFO: Found listing with ID: AK49270
2026-03-28 21:07:23 [auto1.it] INFO: Found listing with ID: TP02469
2026-03-28 21:07:23 [auto1.it] INFO: Found listing with ID: UC14598
2026-03-28 21:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC14598%27 HTTP/1.1" 200 None
2026-03-28 21:07:23 [auto1.it] INFO: Scrape type for UC14598: 1
2026-03-28 21:07:23 [auto1.it] INFO: Found listing with ID: RV10689
2026-03-28 21:07:23 [auto1.it] INFO: Found listing with ID: YV66151
2026-03-28 21:07:23 [auto1.it] INFO: Found listing with ID: NT18683
2026-03-28 21:07:23 [auto1.it] INFO: Found listing with ID: VH18457
2026-03-28 21:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH18457%27 HTTP/1.1" 200 None
2026-03-28 21:07:23 [auto1.it] INFO: Scrape type for VH18457: 2
2026-03-28 21:07:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1da2272-5c98-5c4b-9d8c-f63378fd5a2e with identifier: VH18457
2026-03-28 21:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1da2272-5c98-5c4b-9d8c-f63378fd5a2e with scrape type 2
2026-03-28 21:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1da2272-5c98-5c4b-9d8c-f63378fd5a2e with scrape type 2
2026-03-28 21:07:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a1da2272-5c98-5c4b-9d8c-f63378fd5a2e, identifier: VH18457
2026-03-28 21:07:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a1da2272-5c98-5c4b-9d8c-f63378fd5a2e with identifier: VH18457
2026-03-28 21:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a1da2272-5c98-5c4b-9d8c-f63378fd5a2e with identifier: VH18457
2026-03-28 21:07:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a1da2272-5c98-5c4b-9d8c-f63378fd5a2e with identifier: VH18457 to the API
2026-03-28 21:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:43:57Z',
'fuel_type': 'petrol',
'id': 'a1da2272-5c98-5c4b-9d8c-f63378fd5a2e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH18457',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 80712,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-11',
'seller_name': None,
'title': 'Fiat Panda 1.2 Easy',
'transmission': 'manual',
'trim': 'Easy',
'year': 2018}
2026-03-28 21:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH18457%27 HTTP/1.1" 200 None
2026-03-28 21:07:23 [auto1.it] INFO: Saving data for VH18457: {'auction_closing_time': 1774885437.0, 'created_time': 1773133680.385206, 'last_price_update_time': 1774732043.819653}
2026-03-28 21:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VH18457') HTTP/1.1" 204 0
2026-03-28 21:07:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:23 [auto1.it] INFO: Found listing with ID: PM85940
2026-03-28 21:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM85940%27 HTTP/1.1" 200 None
2026-03-28 21:07:23 [auto1.it] INFO: Scrape type for PM85940: 1
2026-03-28 21:07:23 [auto1.it] INFO: Found listing with ID: UK60459
2026-03-28 21:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK60459%27 HTTP/1.1" 200 None
2026-03-28 21:07:23 [auto1.it] INFO: Scrape type for UK60459: 1
2026-03-28 21:07:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:23 [auto1.it] INFO: Found listing with ID: XJ25634
2026-03-28 21:07:23 [auto1.it] INFO: Found listing with ID: TS00967
2026-03-28 21:07:23 [auto1.it] INFO: Found listing with ID: CZ11807
2026-03-28 21:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ11807%27 HTTP/1.1" 200 None
2026-03-28 21:07:23 [auto1.it] INFO: Scrape type for CZ11807: 1
2026-03-28 21:07:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:23 [auto1.it] INFO: Found listing with ID: HY82012
2026-03-28 21:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY82012%27 HTTP/1.1" 200 None
2026-03-28 21:07:24 [auto1.it] INFO: Scrape type for HY82012: 1
2026-03-28 21:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:24 [auto1.it] INFO: Found listing with ID: MY80647
2026-03-28 21:07:24 [auto1.it] INFO: Found listing with ID: BC50392
2026-03-28 21:07:24 [auto1.it] INFO: Found listing with ID: YD02421
2026-03-28 21:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD02421%27 HTTP/1.1" 200 None
2026-03-28 21:07:24 [auto1.it] INFO: Scrape type for YD02421: 2
2026-03-28 21:07:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dbb60e8-1322-52b6-a7f2-acdb2faf7e2e with identifier: YD02421
2026-03-28 21:07:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dbb60e8-1322-52b6-a7f2-acdb2faf7e2e with scrape type 2
2026-03-28 21:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7dbb60e8-1322-52b6-a7f2-acdb2faf7e2e with scrape type 2
2026-03-28 21:07:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7dbb60e8-1322-52b6-a7f2-acdb2faf7e2e, identifier: YD02421
2026-03-28 21:07:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7dbb60e8-1322-52b6-a7f2-acdb2faf7e2e with identifier: YD02421
2026-03-28 21:07:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7dbb60e8-1322-52b6-a7f2-acdb2faf7e2e with identifier: YD02421
2026-03-28 21:07:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7dbb60e8-1322-52b6-a7f2-acdb2faf7e2e with identifier: YD02421 to the API
2026-03-28 21:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:13:35Z',
'fuel_type': 'diesel',
'id': '7dbb60e8-1322-52b6-a7f2-acdb2faf7e2e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD02421',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 123880,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-13',
'seller_name': None,
'title': 'Peugeot 3008 1.6 Blue-HDi GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2017}
2026-03-28 21:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD02421%27 HTTP/1.1" 200 None
2026-03-28 21:07:24 [auto1.it] INFO: Saving data for YD02421: {'auction_closing_time': 1774883615.0, 'created_time': 1773130008.275233, 'last_price_update_time': 1774732044.562529}
2026-03-28 21:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YD02421') HTTP/1.1" 204 0
2026-03-28 21:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:24 [auto1.it] INFO: Found listing with ID: RK76685
2026-03-28 21:07:24 [auto1.it] INFO: Found listing with ID: HJ04810
2026-03-28 21:07:24 [auto1.it] INFO: Found listing with ID: MR30902
2026-03-28 21:07:24 [auto1.it] INFO: Found listing with ID: JZ43112
2026-03-28 21:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ43112%27 HTTP/1.1" 200 None
2026-03-28 21:07:24 [auto1.it] INFO: Scrape type for JZ43112: 1
2026-03-28 21:07:24 [auto1.it] INFO: Found listing with ID: EF18991
2026-03-28 21:07:24 [auto1.it] INFO: Found listing with ID: PZ93263
2026-03-28 21:07:24 [auto1.it] INFO: Found listing with ID: YD31077
2026-03-28 21:07:24 [auto1.it] INFO: Found listing with ID: WK47884
2026-03-28 21:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK47884%27 HTTP/1.1" 200 None
2026-03-28 21:07:24 [auto1.it] INFO: Scrape type for WK47884: 1
2026-03-28 21:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:24 [auto1.it] INFO: Found listing with ID: GR46256
2026-03-28 21:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR46256%27 HTTP/1.1" 200 None
2026-03-28 21:07:24 [auto1.it] INFO: Scrape type for GR46256: 1
2026-03-28 21:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:24 [auto1.it] INFO: Found listing with ID: KR62960
2026-03-28 21:07:24 [auto1.it] INFO: Found listing with ID: BP72871
2026-03-28 21:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP72871%27 HTTP/1.1" 200 None
2026-03-28 21:07:24 [auto1.it] INFO: Scrape type for BP72871: 2
2026-03-28 21:07:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7cbc86b-6ca0-5f96-aee4-c6af2adbe80f with identifier: BP72871
2026-03-28 21:07:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7cbc86b-6ca0-5f96-aee4-c6af2adbe80f with scrape type 2
2026-03-28 21:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7cbc86b-6ca0-5f96-aee4-c6af2adbe80f with scrape type 2
2026-03-28 21:07:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a7cbc86b-6ca0-5f96-aee4-c6af2adbe80f, identifier: BP72871
2026-03-28 21:07:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a7cbc86b-6ca0-5f96-aee4-c6af2adbe80f with identifier: BP72871
2026-03-28 21:07:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a7cbc86b-6ca0-5f96-aee4-c6af2adbe80f with identifier: BP72871
2026-03-28 21:07:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a7cbc86b-6ca0-5f96-aee4-c6af2adbe80f with identifier: BP72871 to the API
2026-03-28 21:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 91,
'expiration_date': '2026-03-30T15:55:57Z',
'fuel_type': 'petrol',
'id': 'a7cbc86b-6ca0-5f96-aee4-c6af2adbe80f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP72871',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 53867,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-29',
'seller_name': None,
'title': 'Dacia Duster 1.0 TCe Journey',
'transmission': 'manual',
'trim': 'Journey',
'year': 2023}
2026-03-28 21:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP72871%27 HTTP/1.1" 200 None
2026-03-28 21:07:25 [auto1.it] INFO: Saving data for BP72871: {'auction_closing_time': 1774886157.0, 'created_time': 1773134068.252495, 'last_price_update_time': 1774732045.078339}
2026-03-28 21:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BP72871') HTTP/1.1" 204 0
2026-03-28 21:07:25 [auto1.it] INFO: Found listing with ID: MN05358
2026-03-28 21:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN05358%27 HTTP/1.1" 200 None
2026-03-28 21:07:25 [auto1.it] INFO: Scrape type for MN05358: 1
2026-03-28 21:07:25 [auto1.it] INFO: Found listing with ID: NX49735
2026-03-28 21:07:25 [auto1.it] INFO: Found listing with ID: RM50163
2026-03-28 21:07:25 [auto1.it] INFO: Found listing with ID: TH60548
2026-03-28 21:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH60548%27 HTTP/1.1" 200 None
2026-03-28 21:07:25 [auto1.it] INFO: Scrape type for TH60548: 1
2026-03-28 21:07:25 [auto1.it] INFO: Found listing with ID: JM95977
2026-03-28 21:07:25 [auto1.it] INFO: Found listing with ID: SC57434
2026-03-28 21:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC57434%27 HTTP/1.1" 200 None
2026-03-28 21:07:25 [auto1.it] INFO: Scrape type for SC57434: 1
2026-03-28 21:07:25 [auto1.it] INFO: Found listing with ID: WM09394
2026-03-28 21:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PM85940/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CZ11807/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:25 [auto1.it] INFO: Channel: 24h | Page: 43 | totalHits: 2224 | hits on page: 40
2026-03-28 21:07:25 [auto1.it] INFO: Found listing with ID: NH87827
2026-03-28 21:07:25 [auto1.it] INFO: Found listing with ID: EP52133
2026-03-28 21:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP52133%27 HTTP/1.1" 200 None
2026-03-28 21:07:25 [auto1.it] INFO: Scrape type for EP52133: 2
2026-03-28 21:07:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8873e872-ebd5-539e-90c3-2204ba3d7ec6 with identifier: EP52133
2026-03-28 21:07:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8873e872-ebd5-539e-90c3-2204ba3d7ec6 with scrape type 2
2026-03-28 21:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8873e872-ebd5-539e-90c3-2204ba3d7ec6 with scrape type 2
2026-03-28 21:07:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8873e872-ebd5-539e-90c3-2204ba3d7ec6, identifier: EP52133
2026-03-28 21:07:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8873e872-ebd5-539e-90c3-2204ba3d7ec6 with identifier: EP52133
2026-03-28 21:07:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8873e872-ebd5-539e-90c3-2204ba3d7ec6 with identifier: EP52133
2026-03-28 21:07:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8873e872-ebd5-539e-90c3-2204ba3d7ec6 with identifier: EP52133 to the API
2026-03-28 21:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:13:37Z',
'fuel_type': 'diesel',
'id': '8873e872-ebd5-539e-90c3-2204ba3d7ec6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP52133',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 276578,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-08',
'seller_name': None,
'title': 'Kia Sportage 2.0 CRDi Feel 4WD',
'transmission': 'automatic',
'trim': 'Feel 4WD',
'year': 2015}
2026-03-28 21:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP52133%27 HTTP/1.1" 200 None
2026-03-28 21:07:26 [auto1.it] INFO: Saving data for EP52133: {'auction_closing_time': 1774883617.0, 'created_time': 1774343232.497753, 'last_price_update_time': 1774732046.408094}
2026-03-28 21:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EP52133') HTTP/1.1" 204 0
2026-03-28 21:07:26 [auto1.it] INFO: Found listing with ID: PY38952
2026-03-28 21:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY38952%27 HTTP/1.1" 200 None
2026-03-28 21:07:26 [auto1.it] INFO: Scrape type for PY38952: 1
2026-03-28 21:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WK47884/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:26 [auto1.it] INFO: Found listing with ID: GZ68257
2026-03-28 21:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ68257%27 HTTP/1.1" 200 None
2026-03-28 21:07:26 [auto1.it] INFO: Scrape type for GZ68257: 1
2026-03-28 21:07:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HY82012/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JZ43112/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UC14598/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:26 [auto1.it] INFO: Found listing with ID: CG38373
2026-03-28 21:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CG38373%27 HTTP/1.1" 200 None
2026-03-28 21:07:26 [auto1.it] INFO: Scrape type for CG38373: 1
2026-03-28 21:07:26 [auto1.it] INFO: Found listing with ID: KN28324
2026-03-28 21:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KN28324%27 HTTP/1.1" 200 None
2026-03-28 21:07:26 [auto1.it] INFO: Scrape type for KN28324: 1
2026-03-28 21:07:26 [auto1.it] INFO: Found listing with ID: SV68471
2026-03-28 21:07:26 [auto1.it] INFO: Found listing with ID: BH87833
2026-03-28 21:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BH87833%27 HTTP/1.1" 200 None
2026-03-28 21:07:26 [auto1.it] INFO: Scrape type for BH87833: 1
2026-03-28 21:07:26 [auto1.it] INFO: Found listing with ID: NE29040
2026-03-28 21:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE29040%27 HTTP/1.1" 200 None
2026-03-28 21:07:26 [auto1.it] INFO: Scrape type for NE29040: 2
2026-03-28 21:07:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef7db906-54a1-55d0-9efc-86f9d9a281ff with identifier: NE29040
2026-03-28 21:07:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef7db906-54a1-55d0-9efc-86f9d9a281ff with scrape type 2
2026-03-28 21:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef7db906-54a1-55d0-9efc-86f9d9a281ff with scrape type 2
2026-03-28 21:07:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ef7db906-54a1-55d0-9efc-86f9d9a281ff, identifier: NE29040
2026-03-28 21:07:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ef7db906-54a1-55d0-9efc-86f9d9a281ff with identifier: NE29040
2026-03-28 21:07:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ef7db906-54a1-55d0-9efc-86f9d9a281ff with identifier: NE29040
2026-03-28 21:07:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ef7db906-54a1-55d0-9efc-86f9d9a281ff with identifier: NE29040 to the API
2026-03-28 21:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:11:31Z',
'fuel_type': 'diesel',
'id': 'ef7db906-54a1-55d0-9efc-86f9d9a281ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE29040',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 155311,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-01',
'seller_name': None,
'title': 'BMW 3er 320d xDrive',
'transmission': 'manual',
'trim': 'xDrive',
'year': 2011}
2026-03-28 21:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE29040%27 HTTP/1.1" 200 None
2026-03-28 21:07:26 [auto1.it] INFO: Saving data for NE29040: {'auction_closing_time': 1774883491.0, 'created_time': 1774526898.576, 'last_price_update_time': 1774732046.968772}
2026-03-28 21:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NE29040') HTTP/1.1" 204 0
2026-03-28 21:07:27 [auto1.it] INFO: Found listing with ID: RK99012
2026-03-28 21:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK99012%27 HTTP/1.1" 200 None
2026-03-28 21:07:27 [auto1.it] INFO: Scrape type for RK99012: 2
2026-03-28 21:07:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 467bd9ca-1147-593a-93cf-3c992a6bfd4f with identifier: RK99012
2026-03-28 21:07:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 467bd9ca-1147-593a-93cf-3c992a6bfd4f with scrape type 2
2026-03-28 21:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 467bd9ca-1147-593a-93cf-3c992a6bfd4f with scrape type 2
2026-03-28 21:07:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 467bd9ca-1147-593a-93cf-3c992a6bfd4f, identifier: RK99012
2026-03-28 21:07:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 467bd9ca-1147-593a-93cf-3c992a6bfd4f with identifier: RK99012
2026-03-28 21:07:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 467bd9ca-1147-593a-93cf-3c992a6bfd4f with identifier: RK99012
2026-03-28 21:07:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 467bd9ca-1147-593a-93cf-3c992a6bfd4f with identifier: RK99012 to the API
2026-03-28 21:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:29:16Z',
'fuel_type': 'diesel',
'id': '467bd9ca-1147-593a-93cf-3c992a6bfd4f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK99012',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 172610,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-29',
'seller_name': None,
'title': 'Audi A4 2.0 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2018}
2026-03-28 21:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK99012%27 HTTP/1.1" 200 None
2026-03-28 21:07:27 [auto1.it] INFO: Saving data for RK99012: {'auction_closing_time': 1774884556.0, 'created_time': 1774526974.19794, 'last_price_update_time': 1774732047.502364}
2026-03-28 21:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RK99012') HTTP/1.1" 204 0
2026-03-28 21:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GR46256/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:27 [auto1.it] INFO: Found listing with ID: NC22560
2026-03-28 21:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC22560%27 HTTP/1.1" 200 None
2026-03-28 21:07:27 [auto1.it] INFO: Scrape type for NC22560: 1
2026-03-28 21:07:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:27 [auto1.it] INFO: Found listing with ID: FC56913
2026-03-28 21:07:27 [auto1.it] INFO: Found listing with ID: VB76236
2026-03-28 21:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB76236%27 HTTP/1.1" 200 None
2026-03-28 21:07:27 [auto1.it] INFO: Scrape type for VB76236: 2
2026-03-28 21:07:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cecb3f8e-45c8-5199-a496-4fccc2cb26d5 with identifier: VB76236
2026-03-28 21:07:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cecb3f8e-45c8-5199-a496-4fccc2cb26d5 with scrape type 2
2026-03-28 21:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cecb3f8e-45c8-5199-a496-4fccc2cb26d5 with scrape type 2
2026-03-28 21:07:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cecb3f8e-45c8-5199-a496-4fccc2cb26d5, identifier: VB76236
2026-03-28 21:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MN05358/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cecb3f8e-45c8-5199-a496-4fccc2cb26d5 with identifier: VB76236
2026-03-28 21:07:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cecb3f8e-45c8-5199-a496-4fccc2cb26d5 with identifier: VB76236
2026-03-28 21:07:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cecb3f8e-45c8-5199-a496-4fccc2cb26d5 with identifier: VB76236 to the API
2026-03-28 21:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:38:32Z',
'fuel_type': 'diesel',
'id': 'cecb3f8e-45c8-5199-a496-4fccc2cb26d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB76236',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 221865,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-08-30',
'seller_name': None,
'title': 'Citroen C4 Picasso 1.6 HDi Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2009}
2026-03-28 21:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB76236%27 HTTP/1.1" 200 None
2026-03-28 21:07:27 [auto1.it] INFO: Saving data for VB76236: {'auction_closing_time': 1774885112.0, 'created_time': 1774526898.04926, 'last_price_update_time': 1774732047.958751}
2026-03-28 21:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VB76236') HTTP/1.1" 204 0
2026-03-28 21:07:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:27 [auto1.it] INFO: Found listing with ID: TJ16144
2026-03-28 21:07:27 [auto1.it] INFO: Found listing with ID: MP38802
2026-03-28 21:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP38802%27 HTTP/1.1" 200 None
2026-03-28 21:07:28 [auto1.it] INFO: Scrape type for MP38802: 2
2026-03-28 21:07:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8198cab1-0429-559b-b931-7cd22eac9564 with identifier: MP38802
2026-03-28 21:07:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8198cab1-0429-559b-b931-7cd22eac9564 with scrape type 2
2026-03-28 21:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8198cab1-0429-559b-b931-7cd22eac9564 with scrape type 2
2026-03-28 21:07:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8198cab1-0429-559b-b931-7cd22eac9564, identifier: MP38802
2026-03-28 21:07:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8198cab1-0429-559b-b931-7cd22eac9564 with identifier: MP38802
2026-03-28 21:07:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8198cab1-0429-559b-b931-7cd22eac9564 with identifier: MP38802
2026-03-28 21:07:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8198cab1-0429-559b-b931-7cd22eac9564 with identifier: MP38802 to the API
2026-03-28 21:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:03:06Z',
'fuel_type': 'petrol',
'id': '8198cab1-0429-559b-b931-7cd22eac9564',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP38802',
'listing': 'auction',
'make': 'Ford',
'model': 'EcoSport',
'odometer': 118332,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-23',
'seller_name': None,
'title': 'Ford EcoSport 1.0 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2014}
2026-03-28 21:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP38802%27 HTTP/1.1" 200 None
2026-03-28 21:07:28 [auto1.it] INFO: Saving data for MP38802: {'auction_closing_time': 1774882986.0, 'created_time': 1774526805.535927, 'last_price_update_time': 1774732048.402046}
2026-03-28 21:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MP38802') HTTP/1.1" 204 0
2026-03-28 21:07:28 [auto1.it] INFO: Found listing with ID: KV55907
2026-03-28 21:07:28 [auto1.it] INFO: Found listing with ID: BZ51177
2026-03-28 21:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ51177%27 HTTP/1.1" 200 None
2026-03-28 21:07:28 [auto1.it] INFO: Scrape type for BZ51177: 2
2026-03-28 21:07:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c038daf-2c7d-5ead-87ff-6c5f3bb33c7a with identifier: BZ51177
2026-03-28 21:07:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c038daf-2c7d-5ead-87ff-6c5f3bb33c7a with scrape type 2
2026-03-28 21:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c038daf-2c7d-5ead-87ff-6c5f3bb33c7a with scrape type 2
2026-03-28 21:07:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0c038daf-2c7d-5ead-87ff-6c5f3bb33c7a, identifier: BZ51177
2026-03-28 21:07:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0c038daf-2c7d-5ead-87ff-6c5f3bb33c7a with identifier: BZ51177
2026-03-28 21:07:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0c038daf-2c7d-5ead-87ff-6c5f3bb33c7a with identifier: BZ51177
2026-03-28 21:07:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0c038daf-2c7d-5ead-87ff-6c5f3bb33c7a with identifier: BZ51177 to the API
2026-03-28 21:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:26:28Z',
'fuel_type': 'petrol',
'id': '0c038daf-2c7d-5ead-87ff-6c5f3bb33c7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ51177',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 140101,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-12-01',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Highline',
'transmission': 'automatic',
'trim': 'Highline',
'year': 2010}
2026-03-28 21:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BZ51177%27 HTTP/1.1" 200 None
2026-03-28 21:07:28 [auto1.it] INFO: Saving data for BZ51177: {'auction_closing_time': 1774884388.0, 'created_time': 1773130071.460523, 'last_price_update_time': 1774732048.855367}
2026-03-28 21:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BZ51177') HTTP/1.1" 204 0
2026-03-28 21:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TH60548/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:28 [auto1.it] INFO: Found listing with ID: WP46074
2026-03-28 21:07:28 [auto1.it] INFO: Found listing with ID: CY56164
2026-03-28 21:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CY56164%27 HTTP/1.1" 200 None
2026-03-28 21:07:28 [auto1.it] INFO: Scrape type for CY56164: 1
2026-03-28 21:07:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:28 [auto1.it] INFO: Found listing with ID: TB63135
2026-03-28 21:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB63135%27 HTTP/1.1" 200 None
2026-03-28 21:07:28 [auto1.it] INFO: Scrape type for TB63135: 1
2026-03-28 21:07:28 [auto1.it] INFO: Found listing with ID: ZK39903
2026-03-28 21:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK39903%27 HTTP/1.1" 200 None
2026-03-28 21:07:28 [auto1.it] INFO: Scrape type for ZK39903: 2
2026-03-28 21:07:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a753241c-6127-56f5-85a6-8726e681d48c with identifier: ZK39903
2026-03-28 21:07:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a753241c-6127-56f5-85a6-8726e681d48c with scrape type 2
2026-03-28 21:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a753241c-6127-56f5-85a6-8726e681d48c with scrape type 2
2026-03-28 21:07:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a753241c-6127-56f5-85a6-8726e681d48c, identifier: ZK39903
2026-03-28 21:07:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a753241c-6127-56f5-85a6-8726e681d48c with identifier: ZK39903
2026-03-28 21:07:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a753241c-6127-56f5-85a6-8726e681d48c with identifier: ZK39903
2026-03-28 21:07:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a753241c-6127-56f5-85a6-8726e681d48c with identifier: ZK39903 to the API
2026-03-28 21:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 98,
'expiration_date': '2026-03-30T15:27:40Z',
'fuel_type': 'petrol',
'id': 'a753241c-6127-56f5-85a6-8726e681d48c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK39903',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 137683,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-12-28',
'seller_name': None,
'title': 'Renault Clio 1.4 Exception',
'transmission': 'manual',
'trim': 'Exception',
'year': 2006}
2026-03-28 21:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK39903%27 HTTP/1.1" 200 None
2026-03-28 21:07:29 [auto1.it] INFO: Saving data for ZK39903: {'auction_closing_time': 1774884460.0, 'created_time': 1774526800.623142, 'last_price_update_time': 1774732049.345884}
2026-03-28 21:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZK39903') HTTP/1.1" 204 0
2026-03-28 21:07:29 [auto1.it] INFO: Found listing with ID: KZ13497
2026-03-28 21:07:29 [auto1.it] INFO: Found listing with ID: YX84472
2026-03-28 21:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX84472%27 HTTP/1.1" 200 None
2026-03-28 21:07:29 [auto1.it] INFO: Scrape type for YX84472: 1
2026-03-28 21:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SC57434/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PY38952/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:29 [auto1.it] INFO: Found listing with ID: AT73331
2026-03-28 21:07:29 [auto1.it] INFO: Found listing with ID: NW39959
2026-03-28 21:07:29 [auto1.it] INFO: Found listing with ID: YK98276
2026-03-28 21:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK98276%27 HTTP/1.1" 200 None
2026-03-28 21:07:29 [auto1.it] INFO: Scrape type for YK98276: 1
2026-03-28 21:07:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PM85940> (referer: https://www.auto1.com/v1/car-details-view/PM85940/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:29 [auto1.it] INFO: Found listing with ID: CJ64567
2026-03-28 21:07:29 [auto1.it] INFO: Found listing with ID: FK78904
2026-03-28 21:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK78904%27 HTTP/1.1" 200 None
2026-03-28 21:07:29 [auto1.it] INFO: Scrape type for FK78904: 1
2026-03-28 21:07:29 [auto1.it] INFO: Found listing with ID: JC35817
2026-03-28 21:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC35817%27 HTTP/1.1" 200 None
2026-03-28 21:07:29 [auto1.it] INFO: Scrape type for JC35817: 2
2026-03-28 21:07:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cc4b15e-9217-5dbf-9691-eade33b92e2a with identifier: JC35817
2026-03-28 21:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cc4b15e-9217-5dbf-9691-eade33b92e2a with scrape type 2
2026-03-28 21:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cc4b15e-9217-5dbf-9691-eade33b92e2a with scrape type 2
2026-03-28 21:07:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7cc4b15e-9217-5dbf-9691-eade33b92e2a, identifier: JC35817
2026-03-28 21:07:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7cc4b15e-9217-5dbf-9691-eade33b92e2a with identifier: JC35817
2026-03-28 21:07:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7cc4b15e-9217-5dbf-9691-eade33b92e2a with identifier: JC35817
2026-03-28 21:07:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7cc4b15e-9217-5dbf-9691-eade33b92e2a with identifier: JC35817 to the API
2026-03-28 21:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:43:39Z',
'fuel_type': 'petrol',
'id': '7cc4b15e-9217-5dbf-9691-eade33b92e2a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC35817',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 151342,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-02',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 160 Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2009}
2026-03-28 21:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC35817%27 HTTP/1.1" 200 None
2026-03-28 21:07:29 [auto1.it] INFO: Saving data for JC35817: {'auction_closing_time': 1774885419.0, 'created_time': 1774526973.832381, 'last_price_update_time': 1774732049.962706}
2026-03-28 21:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JC35817') HTTP/1.1" 204 0
2026-03-28 21:07:29 [auto1.it] INFO: Found listing with ID: MC76570
2026-03-28 21:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MC76570%27 HTTP/1.1" 200 None
2026-03-28 21:07:30 [auto1.it] INFO: Scrape type for MC76570: 2
2026-03-28 21:07:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 019439e0-2a9e-5717-ae60-37f934b5aa39 with identifier: MC76570
2026-03-28 21:07:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 019439e0-2a9e-5717-ae60-37f934b5aa39 with scrape type 2
2026-03-28 21:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 019439e0-2a9e-5717-ae60-37f934b5aa39 with scrape type 2
2026-03-28 21:07:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 019439e0-2a9e-5717-ae60-37f934b5aa39, identifier: MC76570
2026-03-28 21:07:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 019439e0-2a9e-5717-ae60-37f934b5aa39 with identifier: MC76570
2026-03-28 21:07:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 019439e0-2a9e-5717-ae60-37f934b5aa39 with identifier: MC76570
2026-03-28 21:07:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 019439e0-2a9e-5717-ae60-37f934b5aa39 with identifier: MC76570 to the API
2026-03-28 21:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:12:04Z',
'fuel_type': 'diesel',
'id': '019439e0-2a9e-5717-ae60-37f934b5aa39',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC76570',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Freelander',
'odometer': 171394,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-30',
'seller_name': None,
'title': 'Land Rover Freelander 2.2 Td4 HSE',
'transmission': 'automatic',
'trim': 'HSE',
'year': 2013}
2026-03-28 21:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MC76570%27 HTTP/1.1" 200 None
2026-03-28 21:07:30 [auto1.it] INFO: Saving data for MC76570: {'auction_closing_time': 1774883524.0, 'created_time': 1773129470.616422, 'last_price_update_time': 1774732050.410582}
2026-03-28 21:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MC76570') HTTP/1.1" 204 0
2026-03-28 21:07:30 [auto1.it] INFO: Found listing with ID: ZC44432
2026-03-28 21:07:30 [auto1.it] INFO: Found listing with ID: BB49648
2026-03-28 21:07:30 [auto1.it] INFO: Found listing with ID: NC13614
2026-03-28 21:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC13614%27 HTTP/1.1" 200 None
2026-03-28 21:07:30 [auto1.it] INFO: Scrape type for NC13614: 2
2026-03-28 21:07:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59da1e71-7ec7-5088-b537-77711e443254 with identifier: NC13614
2026-03-28 21:07:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59da1e71-7ec7-5088-b537-77711e443254 with scrape type 2
2026-03-28 21:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59da1e71-7ec7-5088-b537-77711e443254 with scrape type 2
2026-03-28 21:07:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 59da1e71-7ec7-5088-b537-77711e443254, identifier: NC13614
2026-03-28 21:07:30 [auto1.it] INFO: Channel: 24h | Page: 44 | totalHits: 2224 | hits on page: 40
2026-03-28 21:07:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a570ab3-6667-528e-b703-805d6f07358d with identifier: PM85940
2026-03-28 21:07:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a570ab3-6667-528e-b703-805d6f07358d with scrape type 1
2026-03-28 21:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6a570ab3-6667-528e-b703-805d6f07358d
2026-03-28 21:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F17%252Fcd17794c9adfdc253c02c0c63607992c%252Fpa%252FPM85940_c4ebf98679e26862fd9a24c1fa27f840.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_c4ebf98679e26862fd9a24c1fa27f840.jpg not downloaded yet
2026-03-28 21:07:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 59da1e71-7ec7-5088-b537-77711e443254 with identifier: NC13614
2026-03-28 21:07:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 59da1e71-7ec7-5088-b537-77711e443254 with identifier: NC13614
2026-03-28 21:07:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 59da1e71-7ec7-5088-b537-77711e443254 with identifier: NC13614 to the API
2026-03-28 21:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:05:54Z',
'fuel_type': 'diesel',
'id': '59da1e71-7ec7-5088-b537-77711e443254',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC13614',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan Allspace',
'odometer': 149383,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-26',
'seller_name': None,
'title': 'Volkswagen Tiguan Allspace 2.0 TDI Advanced BlueMotion',
'transmission': 'automatic',
'trim': 'Advanced BlueMotion',
'year': 2019}
2026-03-28 21:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC13614%27 HTTP/1.1" 200 None
2026-03-28 21:07:30 [auto1.it] INFO: Saving data for NC13614: {'auction_closing_time': 1774883154.0, 'created_time': 1774559509.754871, 'last_price_update_time': 1774732050.867323}
2026-03-28 21:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NC13614') HTTP/1.1" 204 0
2026-03-28 21:07:30 [auto1.it] INFO: Found listing with ID: GJ99640
2026-03-28 21:07:30 [auto1.it] INFO: Found listing with ID: TT70902
2026-03-28 21:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT70902%27 HTTP/1.1" 200 None
2026-03-28 21:07:31 [auto1.it] INFO: Scrape type for TT70902: 1
2026-03-28 21:07:31 [auto1.it] INFO: Found listing with ID: HY50986
2026-03-28 21:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY50986%27 HTTP/1.1" 200 None
2026-03-28 21:07:31 [auto1.it] INFO: Scrape type for HY50986: 1
2026-03-28 21:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F17%252Fcd17794c9adfdc253c02c0c63607992c%252Fpa%252FPM85940_e7a6f9f128f5b49c49685ed78183ee19.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_e7a6f9f128f5b49c49685ed78183ee19.jpg not downloaded yet
2026-03-28 21:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ68257/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:31 [auto1.it] INFO: Found listing with ID: ZG26295
2026-03-28 21:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZG26295%27 HTTP/1.1" 200 None
2026-03-28 21:07:31 [auto1.it] INFO: Scrape type for ZG26295: 2
2026-03-28 21:07:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86930b8e-8161-5f6e-8998-5b4469b198f2 with identifier: ZG26295
2026-03-28 21:07:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86930b8e-8161-5f6e-8998-5b4469b198f2 with scrape type 2
2026-03-28 21:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86930b8e-8161-5f6e-8998-5b4469b198f2 with scrape type 2
2026-03-28 21:07:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 86930b8e-8161-5f6e-8998-5b4469b198f2, identifier: ZG26295
2026-03-28 21:07:31 [auto1.it] INFO: Found listing with ID: PV47203
2026-03-28 21:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV47203%27 HTTP/1.1" 200 None
2026-03-28 21:07:31 [auto1.it] INFO: Scrape type for PV47203: 1
2026-03-28 21:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F17%252Fcd17794c9adfdc253c02c0c63607992c%252Fpa%252FPM85940_443336954f139e0578927ed279f3c0be.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_443336954f139e0578927ed279f3c0be.jpg not downloaded yet
2026-03-28 21:07:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 86930b8e-8161-5f6e-8998-5b4469b198f2 with identifier: ZG26295
2026-03-28 21:07:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 86930b8e-8161-5f6e-8998-5b4469b198f2 with identifier: ZG26295
2026-03-28 21:07:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 86930b8e-8161-5f6e-8998-5b4469b198f2 with identifier: ZG26295 to the API
2026-03-28 21:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:45:58Z',
'fuel_type': 'petrol',
'id': '86930b8e-8161-5f6e-8998-5b4469b198f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG26295',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 75143,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-06',
'seller_name': None,
'title': 'Fiat 500 1.2 Pop',
'transmission': 'manual',
'trim': 'Pop',
'year': 2017}
2026-03-28 21:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZG26295%27 HTTP/1.1" 200 None
2026-03-28 21:07:31 [auto1.it] INFO: Saving data for ZG26295: {'auction_closing_time': 1774885558.0, 'created_time': 1774526840.554227, 'last_price_update_time': 1774732051.867005}
2026-03-28 21:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZG26295') HTTP/1.1" 204 0
2026-03-28 21:07:31 [auto1.it] INFO: Found listing with ID: CT59426
2026-03-28 21:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT59426%27 HTTP/1.1" 200 None
2026-03-28 21:07:31 [auto1.it] INFO: Scrape type for CT59426: 2
2026-03-28 21:07:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c71c521d-c004-547c-8c87-a12f3fcd1aac with identifier: CT59426
2026-03-28 21:07:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c71c521d-c004-547c-8c87-a12f3fcd1aac with scrape type 2
2026-03-28 21:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c71c521d-c004-547c-8c87-a12f3fcd1aac with scrape type 2
2026-03-28 21:07:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c71c521d-c004-547c-8c87-a12f3fcd1aac, identifier: CT59426
2026-03-28 21:07:31 [auto1.it] INFO: Found listing with ID: YE33932
2026-03-28 21:07:31 [auto1.it] INFO: Found listing with ID: JR36012
2026-03-28 21:07:31 [auto1.it] INFO: Found listing with ID: RS27725
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS27725%27 HTTP/1.1" 200 None
2026-03-28 21:07:32 [auto1.it] INFO: Scrape type for RS27725: 1
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F17%252Fcd17794c9adfdc253c02c0c63607992c%252Fpa%252FPM85940_b681769933655521f831a7d3ed38355d.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_b681769933655521f831a7d3ed38355d.jpg not downloaded yet
2026-03-28 21:07:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c71c521d-c004-547c-8c87-a12f3fcd1aac with identifier: CT59426
2026-03-28 21:07:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c71c521d-c004-547c-8c87-a12f3fcd1aac with identifier: CT59426
2026-03-28 21:07:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c71c521d-c004-547c-8c87-a12f3fcd1aac with identifier: CT59426 to the API
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:30:21Z',
'fuel_type': 'diesel',
'id': 'c71c521d-c004-547c-8c87-a12f3fcd1aac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT59426',
'listing': 'auction',
'make': 'Fiat',
'model': 'Sedici',
'odometer': 160260,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-21',
'seller_name': None,
'title': 'Fiat Sedici 1.9 JTD Multijet Emotion 4x4',
'transmission': 'manual',
'trim': 'Multijet Emotion 4x4',
'year': 2009}
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT59426%27 HTTP/1.1" 200 None
2026-03-28 21:07:32 [auto1.it] INFO: Saving data for CT59426: {'auction_closing_time': 1774884621.0, 'created_time': 1774526978.352029, 'last_price_update_time': 1774732052.313887}
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CT59426') HTTP/1.1" 204 0
2026-03-28 21:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KN28324/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CG38373/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_c4ebf98679e26862fd9a24c1fa27f840.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:32 [auto1.it] INFO: Found listing with ID: GK49763
2026-03-28 21:07:32 [auto1.it] INFO: Found listing with ID: EN63218
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN63218%27 HTTP/1.1" 200 None
2026-03-28 21:07:32 [auto1.it] INFO: Scrape type for EN63218: 1
2026-03-28 21:07:32 [auto1.it] INFO: Found listing with ID: XP44684
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP44684%27 HTTP/1.1" 200 None
2026-03-28 21:07:32 [auto1.it] INFO: Scrape type for XP44684: 1
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F17%252Fcd17794c9adfdc253c02c0c63607992c%252Fpa%252FPM85940_90455a86c66b68bb7ecd6ff62181e680.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_90455a86c66b68bb7ecd6ff62181e680.jpg not downloaded yet
2026-03-28 21:07:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:32 [auto1.it] INFO: Found listing with ID: NM61203
2026-03-28 21:07:32 [auto1.it] INFO: Found listing with ID: ML45383
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML45383%27 HTTP/1.1" 200 None
2026-03-28 21:07:32 [auto1.it] INFO: Scrape type for ML45383: 1
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F17%252Fcd17794c9adfdc253c02c0c63607992c%252Fpa%252FPM85940_8da0cb82a5d4cd8ceb4fe51f5805a465.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_8da0cb82a5d4cd8ceb4fe51f5805a465.jpg not downloaded yet
2026-03-28 21:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UC14598> (referer: https://www.auto1.com/v1/car-details-view/UC14598/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CZ11807> (referer: https://www.auto1.com/v1/car-details-view/CZ11807/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:32 [auto1.it] INFO: Found listing with ID: LJ23422
2026-03-28 21:07:32 [auto1.it] INFO: Found listing with ID: YM04373
2026-03-28 21:07:32 [auto1.it] INFO: Found listing with ID: MZ65778
2026-03-28 21:07:32 [auto1.it] INFO: Found listing with ID: TD58457
2026-03-28 21:07:32 [auto1.it] INFO: Found listing with ID: SB59466
2026-03-28 21:07:32 [auto1.it] INFO: Found listing with ID: BV17272
2026-03-28 21:07:32 [auto1.it] INFO: Found listing with ID: FE93281
2026-03-28 21:07:32 [auto1.it] INFO: Found listing with ID: EG33732
2026-03-28 21:07:32 [auto1.it] INFO: Found listing with ID: TR09676
2026-03-28 21:07:32 [auto1.it] INFO: Found listing with ID: SX65477
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX65477%27 HTTP/1.1" 200 None
2026-03-28 21:07:32 [auto1.it] INFO: Scrape type for SX65477: 1
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F17%252Fcd17794c9adfdc253c02c0c63607992c%252Fpa%252FPM85940_04c008f097bb13629fff03e6e4ddac8d.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_04c008f097bb13629fff03e6e4ddac8d.jpg not downloaded yet
2026-03-28 21:07:32 [auto1.it] INFO: Found listing with ID: DA98342
2026-03-28 21:07:32 [auto1.it] INFO: Found listing with ID: HB00898
2026-03-28 21:07:32 [auto1.it] INFO: Found listing with ID: NF72135
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF72135%27 HTTP/1.1" 200 None
2026-03-28 21:07:32 [auto1.it] INFO: Scrape type for NF72135: 1
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F17%252Fcd17794c9adfdc253c02c0c63607992c%252Fpa%252FPM85940_cc841ece8c9f03570bccd90e6546706a.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_cc841ece8c9f03570bccd90e6546706a.jpg not downloaded yet
2026-03-28 21:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b842f8e50>
2026-03-28 21:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F17%252Fcd17794c9adfdc253c02c0c63607992c%252Fpa%252FPM85940_c4ebf98679e26862fd9a24c1fa27f840.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_c4ebf98679e26862fd9a24c1fa27f840.jpg saved to cache
2026-03-28 21:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6a570ab3-6667-528e-b703-805d6f07358d
2026-03-28 21:07:32 [auto1.it] INFO: Found listing with ID: XS00387
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XS00387%27 HTTP/1.1" 200 None
2026-03-28 21:07:32 [auto1.it] INFO: Scrape type for XS00387: 1
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F17%252Fcd17794c9adfdc253c02c0c63607992c%252Fpa%252FPM85940_dba9118eccce288a0afe4def364d0bf4.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_dba9118eccce288a0afe4def364d0bf4.jpg not downloaded yet
2026-03-28 21:07:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20 with identifier: UC14598
2026-03-28 21:07:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20 with scrape type 1
2026-03-28 21:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F21%252F0721e9d99e98cea5986961822430175a%252Fpa%252FUC14598_7054f2f86bdba136256bde041734a0ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_7054f2f86bdba136256bde041734a0ad.jpg not downloaded yet
2026-03-28 21:07:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce72e27f-11a3-56f7-935a-4f95c1b16dd1 with identifier: CZ11807
2026-03-28 21:07:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce72e27f-11a3-56f7-935a-4f95c1b16dd1 with scrape type 1
2026-03-28 21:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ce72e27f-11a3-56f7-935a-4f95c1b16dd1
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffa%252Fdefa2a3be9835cd65b0bb8e1d98c9656%252Fpa%252FCZ11807_2b5cac990b4f852b9d514c178ebe66ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_2b5cac990b4f852b9d514c178ebe66ae.jpg already downloaded
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffa%252Fdefa2a3be9835cd65b0bb8e1d98c9656%252Fpa%252FCZ11807_d25bdf4116248faac3ea7c7fa70142a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_d25bdf4116248faac3ea7c7fa70142a7.jpg already downloaded
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffa%252Fdefa2a3be9835cd65b0bb8e1d98c9656%252Fpa%252FCZ11807_f8c62cbbec5425765184caac62366b20.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_f8c62cbbec5425765184caac62366b20.jpg already downloaded
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffa%252Fdefa2a3be9835cd65b0bb8e1d98c9656%252Fpa%252FCZ11807_37df4b43d4283819ec08ac6c48433fd3.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_37df4b43d4283819ec08ac6c48433fd3.jpg already downloaded
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffa%252Fdefa2a3be9835cd65b0bb8e1d98c9656%252Fpa%252FCZ11807_7ae973cd76992c905c38c23dd939c012.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_7ae973cd76992c905c38c23dd939c012.jpg already downloaded
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffa%252Fdefa2a3be9835cd65b0bb8e1d98c9656%252Fpa%252FCZ11807_e7602ca710774420f38135654039b623.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_e7602ca710774420f38135654039b623.jpg already downloaded
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffa%252Fdefa2a3be9835cd65b0bb8e1d98c9656%252Fpa%252FCZ11807_e191b5e00464e8adb100f07c5df4ba3a.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_e191b5e00464e8adb100f07c5df4ba3a.jpg already downloaded
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffa%252Fdefa2a3be9835cd65b0bb8e1d98c9656%252Fpa%252FCZ11807_edb1455d1aa8bf2fe28c161fb854923e.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_edb1455d1aa8bf2fe28c161fb854923e.jpg already downloaded
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffa%252Fdefa2a3be9835cd65b0bb8e1d98c9656%252Fpa%252FCZ11807_2e68568f2f7337242cf5d9e0dbcd26e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_2e68568f2f7337242cf5d9e0dbcd26e5.jpg already downloaded
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffa%252Fdefa2a3be9835cd65b0bb8e1d98c9656%252Fpa%252FCZ11807_6dea69cd4609bde05db68be512556177.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_6dea69cd4609bde05db68be512556177.jpg already downloaded
2026-03-28 21:07:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ce72e27f-11a3-56f7-935a-4f95c1b16dd1, identifier: CZ11807
2026-03-28 21:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_b681769933655521f831a7d3ed38355d.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:32 [auto1.it] INFO: Found listing with ID: KA49527
2026-03-28 21:07:32 [auto1.it] INFO: Found listing with ID: AR49211
2026-03-28 21:07:32 [auto1.it] INFO: Found listing with ID: MD59623
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD59623%27 HTTP/1.1" 200 None
2026-03-28 21:07:32 [auto1.it] INFO: Scrape type for MD59623: 1
2026-03-28 21:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F17%252Fcd17794c9adfdc253c02c0c63607992c%252Fpa%252FPM85940_76e253e2607a7aa822052374cc245fe7.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_76e253e2607a7aa822052374cc245fe7.jpg not downloaded yet
2026-03-28 21:07:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ce72e27f-11a3-56f7-935a-4f95c1b16dd1 with identifier: CZ11807
2026-03-28 21:07:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ce72e27f-11a3-56f7-935a-4f95c1b16dd1 with identifier: CZ11807
2026-03-28 21:07:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ce72e27f-11a3-56f7-935a-4f95c1b16dd1 with identifier: CZ11807 to the API
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CZ11807>
{'auction_title': '',
'c_o_2_emission_value': 278,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.3L',
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:23:36Z',
'fuel_type': 'diesel',
'id': 'ce72e27f-11a3-56f7-935a-4f95c1b16dd1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ11807',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Iveco',
'model': 'Daily',
'odometer': 96186,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_2b5cac990b4f852b9d514c178ebe66ae.jpg',
'https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_d25bdf4116248faac3ea7c7fa70142a7.jpg',
'https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_f8c62cbbec5425765184caac62366b20.jpg',
'https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_37df4b43d4283819ec08ac6c48433fd3.jpg',
'https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_7ae973cd76992c905c38c23dd939c012.jpg',
'https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_e7602ca710774420f38135654039b623.jpg',
'https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_e191b5e00464e8adb100f07c5df4ba3a.jpg',
'https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_edb1455d1aa8bf2fe28c161fb854923e.jpg',
'https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_2e68568f2f7337242cf5d9e0dbcd26e5.jpg',
'https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_6dea69cd4609bde05db68be512556177.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce72e27f-11a3-56f7-935a-4f95c1b16dd1/ce72e27f-11a3-56f7-935a-4f95c1b16dd1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54754,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_2b5cac990b4f852b9d514c178ebe66ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce72e27f-11a3-56f7-935a-4f95c1b16dd1/ce72e27f-11a3-56f7-935a-4f95c1b16dd1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2296929,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_d25bdf4116248faac3ea7c7fa70142a7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce72e27f-11a3-56f7-935a-4f95c1b16dd1/ce72e27f-11a3-56f7-935a-4f95c1b16dd1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2646486,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_f8c62cbbec5425765184caac62366b20.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce72e27f-11a3-56f7-935a-4f95c1b16dd1/ce72e27f-11a3-56f7-935a-4f95c1b16dd1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1775489,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_37df4b43d4283819ec08ac6c48433fd3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce72e27f-11a3-56f7-935a-4f95c1b16dd1/ce72e27f-11a3-56f7-935a-4f95c1b16dd1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44828,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_7ae973cd76992c905c38c23dd939c012.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce72e27f-11a3-56f7-935a-4f95c1b16dd1/ce72e27f-11a3-56f7-935a-4f95c1b16dd1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52061,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_e7602ca710774420f38135654039b623.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce72e27f-11a3-56f7-935a-4f95c1b16dd1/ce72e27f-11a3-56f7-935a-4f95c1b16dd1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 22426,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_e191b5e00464e8adb100f07c5df4ba3a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce72e27f-11a3-56f7-935a-4f95c1b16dd1/ce72e27f-11a3-56f7-935a-4f95c1b16dd1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2308807,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_edb1455d1aa8bf2fe28c161fb854923e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce72e27f-11a3-56f7-935a-4f95c1b16dd1/ce72e27f-11a3-56f7-935a-4f95c1b16dd1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46813,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_2e68568f2f7337242cf5d9e0dbcd26e5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce72e27f-11a3-56f7-935a-4f95c1b16dd1/ce72e27f-11a3-56f7-935a-4f95c1b16dd1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2470702,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgde/fa/defa2a3be9835cd65b0bb8e1d98c9656/pa/CZ11807_6dea69cd4609bde05db68be512556177.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-09-10',
'seats_number': 3,
'seller_name': None,
'title': 'Iveco Daily 2.3 Diesel HKa 35 S V Radstand 3520 L',
'transmission': 'manual',
'trim': 'HKa 35 S V Radstand 3520 L',
'year': 2020}
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ11807%27 HTTP/1.1" 200 None
2026-03-28 21:07:33 [auto1.it] INFO: Saving data for CZ11807: {'created_time': 1774732053.306846, 'last_price_update_time': 1774732053.306858, 'auction_closing_time': 1774884216.0}
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CZ11807') HTTP/1.1" 204 0
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F21%252F0721e9d99e98cea5986961822430175a%252Fpa%252FUC14598_04e30caab8ebab2ae4307ce8d14dff2b.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_04e30caab8ebab2ae4307ce8d14dff2b.jpg not downloaded yet
2026-03-28 21:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_8da0cb82a5d4cd8ceb4fe51f5805a465.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:33 [auto1.it] INFO: Found listing with ID: RN27083
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN27083%27 HTTP/1.1" 200 None
2026-03-28 21:07:33 [auto1.it] INFO: Scrape type for RN27083: 1
2026-03-28 21:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JZ43112> (referer: https://www.auto1.com/v1/car-details-view/JZ43112/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F21%252F0721e9d99e98cea5986961822430175a%252Fpa%252FUC14598_b31867a330e53c55caf1a4f575d3d3e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_b31867a330e53c55caf1a4f575d3d3e5.jpg not downloaded yet
2026-03-28 21:07:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HY82012> (referer: https://www.auto1.com/v1/car-details-view/HY82012/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b842a3e50>
2026-03-28 21:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F17%252Fcd17794c9adfdc253c02c0c63607992c%252Fpa%252FPM85940_b681769933655521f831a7d3ed38355d.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_b681769933655521f831a7d3ed38355d.jpg saved to cache
2026-03-28 21:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6a570ab3-6667-528e-b703-805d6f07358d
2026-03-28 21:07:33 [auto1.it] INFO: Found listing with ID: EZ67132
2026-03-28 21:07:33 [auto1.it] INFO: Found listing with ID: RG18197
2026-03-28 21:07:33 [auto1.it] INFO: Found listing with ID: AW19697
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW19697%27 HTTP/1.1" 200 None
2026-03-28 21:07:33 [auto1.it] INFO: Scrape type for AW19697: 1
2026-03-28 21:07:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F21%252F0721e9d99e98cea5986961822430175a%252Fpa%252FUC14598_c8b63e0c93cb7ee67c4a377321f59147.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_c8b63e0c93cb7ee67c4a377321f59147.jpg not downloaded yet
2026-03-28 21:07:33 [auto1.it] INFO: Found listing with ID: UJ83864
2026-03-28 21:07:33 [auto1.it] INFO: Found listing with ID: XM71615
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM71615%27 HTTP/1.1" 200 None
2026-03-28 21:07:33 [auto1.it] INFO: Scrape type for XM71615: 0
2026-03-28 21:07:33 [auto1.it] INFO: Found listing with ID: AG42346
2026-03-28 21:07:33 [auto1.it] INFO: Found listing with ID: RR79025
2026-03-28 21:07:33 [auto1.it] INFO: Found listing with ID: AS99130
2026-03-28 21:07:33 [auto1.it] INFO: Found listing with ID: RH79013
2026-03-28 21:07:33 [auto1.it] INFO: Found listing with ID: JL18468
2026-03-28 21:07:33 [auto1.it] INFO: Found listing with ID: FP31020
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP31020%27 HTTP/1.1" 200 None
2026-03-28 21:07:33 [auto1.it] INFO: Scrape type for FP31020: 0
2026-03-28 21:07:33 [auto1.it] INFO: Found listing with ID: AV18402
2026-03-28 21:07:33 [auto1.it] INFO: Found listing with ID: ZF99216
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZF99216%27 HTTP/1.1" 200 None
2026-03-28 21:07:33 [auto1.it] INFO: Scrape type for ZF99216: 0
2026-03-28 21:07:33 [auto1.it] INFO: Found listing with ID: WF32010
2026-03-28 21:07:33 [auto1.it] INFO: Found listing with ID: XH74376
2026-03-28 21:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b841d4510>
2026-03-28 21:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F17%252Fcd17794c9adfdc253c02c0c63607992c%252Fpa%252FPM85940_8da0cb82a5d4cd8ceb4fe51f5805a465.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_8da0cb82a5d4cd8ceb4fe51f5805a465.jpg saved to cache
2026-03-28 21:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6a570ab3-6667-528e-b703-805d6f07358d
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F21%252F0721e9d99e98cea5986961822430175a%252Fpa%252FUC14598_8241585179025d2e89861e24132d3189.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_8241585179025d2e89861e24132d3189.jpg not downloaded yet
2026-03-28 21:07:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 315c9bdf-285c-5926-9dd6-0258eed8d18b with identifier: JZ43112
2026-03-28 21:07:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 315c9bdf-285c-5926-9dd6-0258eed8d18b with scrape type 1
2026-03-28 21:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 315c9bdf-285c-5926-9dd6-0258eed8d18b
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d8a1afc6d133d8509d78b60be5b26%252Fpa%252FJZ43112_23f06d0673ae6399fd4ac67c225231ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_23f06d0673ae6399fd4ac67c225231ec.jpg already downloaded
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d8a1afc6d133d8509d78b60be5b26%252Fpa%252FJZ43112_c54a17891208a1ab875e8ea5f3fe5fab.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_c54a17891208a1ab875e8ea5f3fe5fab.jpg already downloaded
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d8a1afc6d133d8509d78b60be5b26%252Fpa%252FJZ43112_d4cf95530ed6a22c42a3d79202f580a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_d4cf95530ed6a22c42a3d79202f580a4.jpg already downloaded
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d8a1afc6d133d8509d78b60be5b26%252Fpa%252FJZ43112_05974ebe5449601e323e7ab1aabc9b98.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_05974ebe5449601e323e7ab1aabc9b98.jpg already downloaded
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d8a1afc6d133d8509d78b60be5b26%252Fpa%252FJZ43112_5dda48b1d30e68496a1d24854c8d070c.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_5dda48b1d30e68496a1d24854c8d070c.jpg already downloaded
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d8a1afc6d133d8509d78b60be5b26%252Fpa%252FJZ43112_4d2b074743032139b716de6380b7a50c.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_4d2b074743032139b716de6380b7a50c.jpg already downloaded
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d8a1afc6d133d8509d78b60be5b26%252Fpa%252FJZ43112_b5f878d3430da9492c960df54891ac65.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_b5f878d3430da9492c960df54891ac65.jpg already downloaded
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d8a1afc6d133d8509d78b60be5b26%252Fpa%252FJZ43112_4cae328076069b41dd9f38b9abcdb4a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_4cae328076069b41dd9f38b9abcdb4a6.jpg already downloaded
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d8a1afc6d133d8509d78b60be5b26%252Fpa%252FJZ43112_3492f0f8fd33eccea02481753ac2e7d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_3492f0f8fd33eccea02481753ac2e7d6.jpg already downloaded
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F5d%252Ffe5d8a1afc6d133d8509d78b60be5b26%252Fpa%252FJZ43112_76a21afa748300ec638efc11e69cbfda.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_76a21afa748300ec638efc11e69cbfda.jpg already downloaded
2026-03-28 21:07:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 315c9bdf-285c-5926-9dd6-0258eed8d18b, identifier: JZ43112
2026-03-28 21:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_dba9118eccce288a0afe4def364d0bf4.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F21%252F0721e9d99e98cea5986961822430175a%252Fpa%252FUC14598_dba6effaa88b21118f475a13722d793b.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_dba6effaa88b21118f475a13722d793b.jpg not downloaded yet
2026-03-28 21:07:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 315c9bdf-285c-5926-9dd6-0258eed8d18b with identifier: JZ43112
2026-03-28 21:07:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 315c9bdf-285c-5926-9dd6-0258eed8d18b with identifier: JZ43112
2026-03-28 21:07:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 315c9bdf-285c-5926-9dd6-0258eed8d18b with identifier: JZ43112 to the API
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JZ43112>
{'auction_title': '',
'c_o_2_emission_value': 168,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 197,
'expiration_date': '2026-03-30T15:57:54Z',
'fuel_type': 'diesel',
'id': '315c9bdf-285c-5926-9dd6-0258eed8d18b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ43112',
'listing': 'auction',
'location': 'IT, Bentivoglio (BO)',
'make': 'Volvo',
'model': 'XC60',
'odometer': 233097,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_23f06d0673ae6399fd4ac67c225231ec.jpg',
'https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_c54a17891208a1ab875e8ea5f3fe5fab.jpg',
'https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_d4cf95530ed6a22c42a3d79202f580a4.jpg',
'https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_05974ebe5449601e323e7ab1aabc9b98.jpg',
'https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_5dda48b1d30e68496a1d24854c8d070c.jpg',
'https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_4d2b074743032139b716de6380b7a50c.jpg',
'https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_b5f878d3430da9492c960df54891ac65.jpg',
'https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_4cae328076069b41dd9f38b9abcdb4a6.jpg',
'https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_3492f0f8fd33eccea02481753ac2e7d6.jpg',
'https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_76a21afa748300ec638efc11e69cbfda.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315c9bdf-285c-5926-9dd6-0258eed8d18b/315c9bdf-285c-5926-9dd6-0258eed8d18b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75359,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_23f06d0673ae6399fd4ac67c225231ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315c9bdf-285c-5926-9dd6-0258eed8d18b/315c9bdf-285c-5926-9dd6-0258eed8d18b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68346,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_c54a17891208a1ab875e8ea5f3fe5fab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315c9bdf-285c-5926-9dd6-0258eed8d18b/315c9bdf-285c-5926-9dd6-0258eed8d18b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60733,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_d4cf95530ed6a22c42a3d79202f580a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315c9bdf-285c-5926-9dd6-0258eed8d18b/315c9bdf-285c-5926-9dd6-0258eed8d18b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2621897,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_05974ebe5449601e323e7ab1aabc9b98.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315c9bdf-285c-5926-9dd6-0258eed8d18b/315c9bdf-285c-5926-9dd6-0258eed8d18b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49014,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_5dda48b1d30e68496a1d24854c8d070c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315c9bdf-285c-5926-9dd6-0258eed8d18b/315c9bdf-285c-5926-9dd6-0258eed8d18b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60766,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_4d2b074743032139b716de6380b7a50c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315c9bdf-285c-5926-9dd6-0258eed8d18b/315c9bdf-285c-5926-9dd6-0258eed8d18b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51251,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_b5f878d3430da9492c960df54891ac65.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315c9bdf-285c-5926-9dd6-0258eed8d18b/315c9bdf-285c-5926-9dd6-0258eed8d18b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70167,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_4cae328076069b41dd9f38b9abcdb4a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315c9bdf-285c-5926-9dd6-0258eed8d18b/315c9bdf-285c-5926-9dd6-0258eed8d18b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71801,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_3492f0f8fd33eccea02481753ac2e7d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315c9bdf-285c-5926-9dd6-0258eed8d18b/315c9bdf-285c-5926-9dd6-0258eed8d18b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59121,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfe/5d/fe5d8a1afc6d133d8509d78b60be5b26/pa/JZ43112_76a21afa748300ec638efc11e69cbfda.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-12-27',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC60 2.0 B4 Mild-Hybrid Plus Dark AWD',
'transmission': 'automatic',
'trim': 'Plus Dark AWD',
'year': 2022}
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ43112%27 HTTP/1.1" 200 None
2026-03-28 21:07:34 [auto1.it] INFO: Saving data for JZ43112: {'created_time': 1774732054.36589, 'last_price_update_time': 1774732054.365902, 'auction_closing_time': 1774886274.0}
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JZ43112') HTTP/1.1" 204 0
2026-03-28 21:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_04e30caab8ebab2ae4307ce8d14dff2b.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cbbfdb6-85e5-5dcd-b703-c31c65cc9ff9 with identifier: HY82012
2026-03-28 21:07:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cbbfdb6-85e5-5dcd-b703-c31c65cc9ff9 with scrape type 1
2026-03-28 21:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0cbbfdb6-85e5-5dcd-b703-c31c65cc9ff9
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0534725f8cb147410f44ca2ace8b1a%252Fpa%252FHY82012_804f2a9168f382d1c584762417bdb132.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_804f2a9168f382d1c584762417bdb132.jpg already downloaded
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0534725f8cb147410f44ca2ace8b1a%252Fpa%252FHY82012_62f2fb0b7091975d31f52dfecf2c67ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_62f2fb0b7091975d31f52dfecf2c67ae.jpg already downloaded
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0534725f8cb147410f44ca2ace8b1a%252Fpa%252FHY82012_607b02077a2481486cde18466a1db2ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_607b02077a2481486cde18466a1db2ba.jpg already downloaded
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0534725f8cb147410f44ca2ace8b1a%252Fpa%252FHY82012_62b8dea1c7bb6d6d3e5bdd331bac7eb0.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_62b8dea1c7bb6d6d3e5bdd331bac7eb0.jpg already downloaded
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0534725f8cb147410f44ca2ace8b1a%252Fpa%252FHY82012_fdff5c91012d3d2591c2a9fb1d095511.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_fdff5c91012d3d2591c2a9fb1d095511.jpg already downloaded
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0534725f8cb147410f44ca2ace8b1a%252Fpa%252FHY82012_2ce0dd08b762258d3994672f46ee968f.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_2ce0dd08b762258d3994672f46ee968f.jpg already downloaded
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0534725f8cb147410f44ca2ace8b1a%252Fpa%252FHY82012_0a5f46113000cd231aadb7e04a006bb6.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_0a5f46113000cd231aadb7e04a006bb6.jpg already downloaded
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0534725f8cb147410f44ca2ace8b1a%252Fpa%252FHY82012_1e4b5f35552bb361ef52ef9f000dd7fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_1e4b5f35552bb361ef52ef9f000dd7fa.jpg already downloaded
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0534725f8cb147410f44ca2ace8b1a%252Fpa%252FHY82012_dcb46aac12d6c7c7d67fb08bb0125fd4.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_dcb46aac12d6c7c7d67fb08bb0125fd4.jpg already downloaded
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0534725f8cb147410f44ca2ace8b1a%252Fpa%252FHY82012_133cd7cf658574a4be402f15f9decfab.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_133cd7cf658574a4be402f15f9decfab.jpg already downloaded
2026-03-28 21:07:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0cbbfdb6-85e5-5dcd-b703-c31c65cc9ff9, identifier: HY82012
2026-03-28 21:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_76e253e2607a7aa822052374cc245fe7.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F21%252F0721e9d99e98cea5986961822430175a%252Fpa%252FUC14598_0c8b7463adce7b172255b8219abfdb73.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_0c8b7463adce7b172255b8219abfdb73.jpg not downloaded yet
2026-03-28 21:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NC22560/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0cbbfdb6-85e5-5dcd-b703-c31c65cc9ff9 with identifier: HY82012
2026-03-28 21:07:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0cbbfdb6-85e5-5dcd-b703-c31c65cc9ff9 with identifier: HY82012
2026-03-28 21:07:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0cbbfdb6-85e5-5dcd-b703-c31c65cc9ff9 with identifier: HY82012 to the API
2026-03-28 21:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HY82012>
{'auction_title': '',
'c_o_2_emission_value': 143,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:15:01Z',
'fuel_type': 'petrol',
'id': '0cbbfdb6-85e5-5dcd-b703-c31c65cc9ff9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY82012',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Peugeot',
'model': '2008',
'odometer': 77702,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_804f2a9168f382d1c584762417bdb132.jpg',
'https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_62f2fb0b7091975d31f52dfecf2c67ae.jpg',
'https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_607b02077a2481486cde18466a1db2ba.jpg',
'https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_62b8dea1c7bb6d6d3e5bdd331bac7eb0.jpg',
'https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_fdff5c91012d3d2591c2a9fb1d095511.jpg',
'https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_2ce0dd08b762258d3994672f46ee968f.jpg',
'https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_0a5f46113000cd231aadb7e04a006bb6.jpg',
'https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_1e4b5f35552bb361ef52ef9f000dd7fa.jpg',
'https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_dcb46aac12d6c7c7d67fb08bb0125fd4.jpg',
'https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_133cd7cf658574a4be402f15f9decfab.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cbbfdb6-85e5-5dcd-b703-c31c65cc9ff9/0cbbfdb6-85e5-5dcd-b703-c31c65cc9ff9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2457695,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_804f2a9168f382d1c584762417bdb132.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cbbfdb6-85e5-5dcd-b703-c31c65cc9ff9/0cbbfdb6-85e5-5dcd-b703-c31c65cc9ff9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70585,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_62f2fb0b7091975d31f52dfecf2c67ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cbbfdb6-85e5-5dcd-b703-c31c65cc9ff9/0cbbfdb6-85e5-5dcd-b703-c31c65cc9ff9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66961,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_607b02077a2481486cde18466a1db2ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cbbfdb6-85e5-5dcd-b703-c31c65cc9ff9/0cbbfdb6-85e5-5dcd-b703-c31c65cc9ff9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64735,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_62b8dea1c7bb6d6d3e5bdd331bac7eb0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cbbfdb6-85e5-5dcd-b703-c31c65cc9ff9/0cbbfdb6-85e5-5dcd-b703-c31c65cc9ff9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61982,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_fdff5c91012d3d2591c2a9fb1d095511.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cbbfdb6-85e5-5dcd-b703-c31c65cc9ff9/0cbbfdb6-85e5-5dcd-b703-c31c65cc9ff9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2485880,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_2ce0dd08b762258d3994672f46ee968f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cbbfdb6-85e5-5dcd-b703-c31c65cc9ff9/0cbbfdb6-85e5-5dcd-b703-c31c65cc9ff9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68778,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_0a5f46113000cd231aadb7e04a006bb6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cbbfdb6-85e5-5dcd-b703-c31c65cc9ff9/0cbbfdb6-85e5-5dcd-b703-c31c65cc9ff9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2538456,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_1e4b5f35552bb361ef52ef9f000dd7fa.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cbbfdb6-85e5-5dcd-b703-c31c65cc9ff9/0cbbfdb6-85e5-5dcd-b703-c31c65cc9ff9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59545,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_dcb46aac12d6c7c7d67fb08bb0125fd4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cbbfdb6-85e5-5dcd-b703-c31c65cc9ff9/0cbbfdb6-85e5-5dcd-b703-c31c65cc9ff9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63378,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/05/ed0534725f8cb147410f44ca2ace8b1a/pa/HY82012_133cd7cf658574a4be402f15f9decfab.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-10-18',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure Business',
'transmission': 'automatic',
'trim': 'Allure Business',
'year': 2021}
2026-03-28 21:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY82012%27 HTTP/1.1" 200 None
2026-03-28 21:07:35 [auto1.it] INFO: Saving data for HY82012: {'created_time': 1774732055.793416, 'last_price_update_time': 1774732055.793429, 'auction_closing_time': 1774883701.0}
2026-03-28 21:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HY82012') HTTP/1.1" 204 0
2026-03-28 21:07:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WK47884> (referer: https://www.auto1.com/v1/car-details-view/WK47884/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84142cd0>
2026-03-28 21:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 21:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F17%252Fcd17794c9adfdc253c02c0c63607992c%252Fpa%252FPM85940_dba9118eccce288a0afe4def364d0bf4.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_dba9118eccce288a0afe4def364d0bf4.jpg saved to cache
2026-03-28 21:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6a570ab3-6667-528e-b703-805d6f07358d
2026-03-28 21:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F21%252F0721e9d99e98cea5986961822430175a%252Fpa%252FUC14598_c47db53f307fba08454af06ad5a73ae9.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_c47db53f307fba08454af06ad5a73ae9.jpg not downloaded yet
2026-03-28 21:07:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MN05358> (referer: https://www.auto1.com/v1/car-details-view/MN05358/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7f712790>
2026-03-28 21:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20/ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20_image_1.jpg HTTP/1.1" 201 0
2026-03-28 21:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F21%252F0721e9d99e98cea5986961822430175a%252Fpa%252FUC14598_04e30caab8ebab2ae4307ce8d14dff2b.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_04e30caab8ebab2ae4307ce8d14dff2b.jpg saved to cache
2026-03-28 21:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20
2026-03-28 21:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_8241585179025d2e89861e24132d3189.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8432d6d0>
2026-03-28 21:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 21:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F17%252Fcd17794c9adfdc253c02c0c63607992c%252Fpa%252FPM85940_76e253e2607a7aa822052374cc245fe7.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_76e253e2607a7aa822052374cc245fe7.jpg saved to cache
2026-03-28 21:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6a570ab3-6667-528e-b703-805d6f07358d
2026-03-28 21:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F21%252F0721e9d99e98cea5986961822430175a%252Fpa%252FUC14598_014956fd2124929898f41cab05191b80.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_014956fd2124929898f41cab05191b80.jpg not downloaded yet
2026-03-28 21:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_c8b63e0c93cb7ee67c4a377321f59147.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e82d2048-df0e-5cac-be88-c24cde357d15 with identifier: WK47884
2026-03-28 21:07:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e82d2048-df0e-5cac-be88-c24cde357d15 with scrape type 1
2026-03-28 21:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e82d2048-df0e-5cac-be88-c24cde357d15
2026-03-28 21:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Ffb%252Fd3fb5a9ca9f3914f4612195dda3cc2a7%252Fpa%252FWK47884_f4afc2c6a6fced7be4a2ff24c17dce81.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fb/d3fb5a9ca9f3914f4612195dda3cc2a7/pa/WK47884_f4afc2c6a6fced7be4a2ff24c17dce81.jpg already downloaded
2026-03-28 21:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Ffb%252Fd3fb5a9ca9f3914f4612195dda3cc2a7%252Fpa%252FWK47884_ae0db6c8c65c01062d56da1cfe71968c.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fb/d3fb5a9ca9f3914f4612195dda3cc2a7/pa/WK47884_ae0db6c8c65c01062d56da1cfe71968c.jpg already downloaded
2026-03-28 21:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Ffb%252Fd3fb5a9ca9f3914f4612195dda3cc2a7%252Fpa%252FWK47884_cd22014f1cbb2f5bd64f0c5286391d68.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fb/d3fb5a9ca9f3914f4612195dda3cc2a7/pa/WK47884_cd22014f1cbb2f5bd64f0c5286391d68.jpg already downloaded
2026-03-28 21:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Ffb%252Fd3fb5a9ca9f3914f4612195dda3cc2a7%252Fpa%252FWK47884_0ff6986813822dcb40a2d77022c65c06.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fb/d3fb5a9ca9f3914f4612195dda3cc2a7/pa/WK47884_0ff6986813822dcb40a2d77022c65c06.jpg already downloaded
2026-03-28 21:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Ffb%252Fd3fb5a9ca9f3914f4612195dda3cc2a7%252Fpa%252FWK47884_aab3407612a75b3ad366ccdd5337cffe.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fb/d3fb5a9ca9f3914f4612195dda3cc2a7/pa/WK47884_aab3407612a75b3ad366ccdd5337cffe.jpg already downloaded
2026-03-28 21:07:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e82d2048-df0e-5cac-be88-c24cde357d15, identifier: WK47884
2026-03-28 21:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F21%252F0721e9d99e98cea5986961822430175a%252Fpa%252FUC14598_0d6b2e06df3cffea6c9c657f5edbea13.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_0d6b2e06df3cffea6c9c657f5edbea13.jpg not downloaded yet
2026-03-28 21:07:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e82d2048-df0e-5cac-be88-c24cde357d15 with identifier: WK47884
2026-03-28 21:07:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e82d2048-df0e-5cac-be88-c24cde357d15 with identifier: WK47884
2026-03-28 21:07:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e82d2048-df0e-5cac-be88-c24cde357d15 with identifier: WK47884 to the API
2026-03-28 21:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WK47884>
{'auction_title': '',
'c_o_2_emission_value': 111,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.0L',
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:52:01Z',
'fuel_type': 'petrol',
'id': 'e82d2048-df0e-5cac-be88-c24cde357d15',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK47884',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 227157,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/imgd3/fb/d3fb5a9ca9f3914f4612195dda3cc2a7/pa/WK47884_f4afc2c6a6fced7be4a2ff24c17dce81.jpg',
'https://img-pa.auto1.com/imgd3/fb/d3fb5a9ca9f3914f4612195dda3cc2a7/pa/WK47884_ae0db6c8c65c01062d56da1cfe71968c.jpg',
'https://img-pa.auto1.com/imgd3/fb/d3fb5a9ca9f3914f4612195dda3cc2a7/pa/WK47884_cd22014f1cbb2f5bd64f0c5286391d68.jpg',
'https://img-pa.auto1.com/imgd3/fb/d3fb5a9ca9f3914f4612195dda3cc2a7/pa/WK47884_0ff6986813822dcb40a2d77022c65c06.jpg',
'https://img-pa.auto1.com/imgd3/fb/d3fb5a9ca9f3914f4612195dda3cc2a7/pa/WK47884_aab3407612a75b3ad366ccdd5337cffe.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e82d2048-df0e-5cac-be88-c24cde357d15/e82d2048-df0e-5cac-be88-c24cde357d15_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89048,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/fb/d3fb5a9ca9f3914f4612195dda3cc2a7/pa/WK47884_f4afc2c6a6fced7be4a2ff24c17dce81.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e82d2048-df0e-5cac-be88-c24cde357d15/e82d2048-df0e-5cac-be88-c24cde357d15_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84446,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/fb/d3fb5a9ca9f3914f4612195dda3cc2a7/pa/WK47884_ae0db6c8c65c01062d56da1cfe71968c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e82d2048-df0e-5cac-be88-c24cde357d15/e82d2048-df0e-5cac-be88-c24cde357d15_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83755,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/fb/d3fb5a9ca9f3914f4612195dda3cc2a7/pa/WK47884_cd22014f1cbb2f5bd64f0c5286391d68.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e82d2048-df0e-5cac-be88-c24cde357d15/e82d2048-df0e-5cac-be88-c24cde357d15_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77227,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/fb/d3fb5a9ca9f3914f4612195dda3cc2a7/pa/WK47884_0ff6986813822dcb40a2d77022c65c06.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e82d2048-df0e-5cac-be88-c24cde357d15/e82d2048-df0e-5cac-be88-c24cde357d15_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49760,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/fb/d3fb5a9ca9f3914f4612195dda3cc2a7/pa/WK47884_aab3407612a75b3ad366ccdd5337cffe.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-04-16',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris 1.0 VVT-i Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2014}
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK47884%27 HTTP/1.1" 200 None
2026-03-28 21:07:37 [auto1.it] INFO: Saving data for WK47884: {'created_time': 1774732057.330066, 'last_price_update_time': 1774732057.330079, 'auction_closing_time': 1774885921.0}
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WK47884') HTTP/1.1" 204 0
2026-03-28 21:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_0c8b7463adce7b172255b8219abfdb73.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_dba6effaa88b21118f475a13722d793b.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_b31867a330e53c55caf1a4f575d3d3e5.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7935f535-a3eb-5fc1-939a-e05762740be1 with identifier: MN05358
2026-03-28 21:07:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7935f535-a3eb-5fc1-939a-e05762740be1 with scrape type 1
2026-03-28 21:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7935f535-a3eb-5fc1-939a-e05762740be1
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F6f%252Fda6f7a28cf2f6d41ba574fedacd73ced%252Fpa%252FMN05358_793a6c6ae55ea62ead33a84ee2623564.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_793a6c6ae55ea62ead33a84ee2623564.jpg already downloaded
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F6f%252Fda6f7a28cf2f6d41ba574fedacd73ced%252Fpa%252FMN05358_e70dd8a7c6a6a445b88d83d6f6d31efc.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_e70dd8a7c6a6a445b88d83d6f6d31efc.jpg already downloaded
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F6f%252Fda6f7a28cf2f6d41ba574fedacd73ced%252Fpa%252FMN05358_4c6d4abd496e38c2a8bf42c14dc597c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_4c6d4abd496e38c2a8bf42c14dc597c4.jpg already downloaded
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F6f%252Fda6f7a28cf2f6d41ba574fedacd73ced%252Fpa%252FMN05358_5fc43b79416222a82f830d94476be3df.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_5fc43b79416222a82f830d94476be3df.jpg already downloaded
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F6f%252Fda6f7a28cf2f6d41ba574fedacd73ced%252Fpa%252FMN05358_4fa94b9b0a1df1f2debb1752ecccf8de.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_4fa94b9b0a1df1f2debb1752ecccf8de.jpg already downloaded
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F6f%252Fda6f7a28cf2f6d41ba574fedacd73ced%252Fpa%252FMN05358_6ca8838b59683000da0ddde977c79769.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_6ca8838b59683000da0ddde977c79769.jpg already downloaded
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F6f%252Fda6f7a28cf2f6d41ba574fedacd73ced%252Fpa%252FMN05358_ab42b2fab8b0851b48c75deedb8991cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_ab42b2fab8b0851b48c75deedb8991cb.jpg already downloaded
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F6f%252Fda6f7a28cf2f6d41ba574fedacd73ced%252Fpa%252FMN05358_3663e8464d7735ca115f86b3903088ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_3663e8464d7735ca115f86b3903088ee.jpg already downloaded
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F6f%252Fda6f7a28cf2f6d41ba574fedacd73ced%252Fpa%252FMN05358_4e53f97a1a8e9dc7b66f0589c9951513.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_4e53f97a1a8e9dc7b66f0589c9951513.jpg already downloaded
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F6f%252Fda6f7a28cf2f6d41ba574fedacd73ced%252Fpa%252FMN05358_ca550022f4d2bf95b2def4456d25dbae.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_ca550022f4d2bf95b2def4456d25dbae.jpg already downloaded
2026-03-28 21:07:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7935f535-a3eb-5fc1-939a-e05762740be1, identifier: MN05358
2026-03-28 21:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b861e6d90>
2026-03-28 21:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20/ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20_image_4.jpg HTTP/1.1" 201 0
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F21%252F0721e9d99e98cea5986961822430175a%252Fpa%252FUC14598_8241585179025d2e89861e24132d3189.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_8241585179025d2e89861e24132d3189.jpg saved to cache
2026-03-28 21:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20
2026-03-28 21:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8424d010>
2026-03-28 21:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20/ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20_image_3.jpg HTTP/1.1" 201 0
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F21%252F0721e9d99e98cea5986961822430175a%252Fpa%252FUC14598_c8b63e0c93cb7ee67c4a377321f59147.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_c8b63e0c93cb7ee67c4a377321f59147.jpg saved to cache
2026-03-28 21:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20
2026-03-28 21:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TB63135/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CY56164/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7935f535-a3eb-5fc1-939a-e05762740be1 with identifier: MN05358
2026-03-28 21:07:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7935f535-a3eb-5fc1-939a-e05762740be1 with identifier: MN05358
2026-03-28 21:07:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7935f535-a3eb-5fc1-939a-e05762740be1 with identifier: MN05358 to the API
2026-03-28 21:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MN05358>
{'auction_title': '',
'c_o_2_emission_value': 11,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:47:54Z',
'fuel_type': 'diesel',
'id': '7935f535-a3eb-5fc1-939a-e05762740be1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN05358',
'listing': 'auction',
'location': 'IT, Padova',
'make': 'Audi',
'model': 'A4',
'odometer': 193290,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_793a6c6ae55ea62ead33a84ee2623564.jpg',
'https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_e70dd8a7c6a6a445b88d83d6f6d31efc.jpg',
'https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_4c6d4abd496e38c2a8bf42c14dc597c4.jpg',
'https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_5fc43b79416222a82f830d94476be3df.jpg',
'https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_4fa94b9b0a1df1f2debb1752ecccf8de.jpg',
'https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_6ca8838b59683000da0ddde977c79769.jpg',
'https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_ab42b2fab8b0851b48c75deedb8991cb.jpg',
'https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_3663e8464d7735ca115f86b3903088ee.jpg',
'https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_4e53f97a1a8e9dc7b66f0589c9951513.jpg',
'https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_ca550022f4d2bf95b2def4456d25dbae.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7935f535-a3eb-5fc1-939a-e05762740be1/7935f535-a3eb-5fc1-939a-e05762740be1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72058,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_793a6c6ae55ea62ead33a84ee2623564.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7935f535-a3eb-5fc1-939a-e05762740be1/7935f535-a3eb-5fc1-939a-e05762740be1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67290,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_e70dd8a7c6a6a445b88d83d6f6d31efc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7935f535-a3eb-5fc1-939a-e05762740be1/7935f535-a3eb-5fc1-939a-e05762740be1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66838,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_4c6d4abd496e38c2a8bf42c14dc597c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7935f535-a3eb-5fc1-939a-e05762740be1/7935f535-a3eb-5fc1-939a-e05762740be1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50130,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_5fc43b79416222a82f830d94476be3df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7935f535-a3eb-5fc1-939a-e05762740be1/7935f535-a3eb-5fc1-939a-e05762740be1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59727,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_4fa94b9b0a1df1f2debb1752ecccf8de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7935f535-a3eb-5fc1-939a-e05762740be1/7935f535-a3eb-5fc1-939a-e05762740be1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62124,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_6ca8838b59683000da0ddde977c79769.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7935f535-a3eb-5fc1-939a-e05762740be1/7935f535-a3eb-5fc1-939a-e05762740be1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2099438,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_ab42b2fab8b0851b48c75deedb8991cb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7935f535-a3eb-5fc1-939a-e05762740be1/7935f535-a3eb-5fc1-939a-e05762740be1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67743,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_3663e8464d7735ca115f86b3903088ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7935f535-a3eb-5fc1-939a-e05762740be1/7935f535-a3eb-5fc1-939a-e05762740be1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67073,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_4e53f97a1a8e9dc7b66f0589c9951513.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7935f535-a3eb-5fc1-939a-e05762740be1/7935f535-a3eb-5fc1-939a-e05762740be1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48445,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/6f/da6f7a28cf2f6d41ba574fedacd73ced/pa/MN05358_ca550022f4d2bf95b2def4456d25dbae.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-03-26',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 2.0 TDI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2017}
2026-03-28 21:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN05358%27 HTTP/1.1" 200 None
2026-03-28 21:07:38 [auto1.it] INFO: Saving data for MN05358: {'created_time': 1774732058.776293, 'last_price_update_time': 1774732058.776307, 'auction_closing_time': 1774885674.0}
2026-03-28 21:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MN05358') HTTP/1.1" 204 0
2026-03-28 21:07:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b843001d0>
2026-03-28 21:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20/ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20_image_6.jpg HTTP/1.1" 201 0
2026-03-28 21:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F21%252F0721e9d99e98cea5986961822430175a%252Fpa%252FUC14598_0c8b7463adce7b172255b8219abfdb73.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_0c8b7463adce7b172255b8219abfdb73.jpg saved to cache
2026-03-28 21:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20
2026-03-28 21:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84127090>
2026-03-28 21:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20/ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20_image_5.jpg HTTP/1.1" 201 0
2026-03-28 21:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F21%252F0721e9d99e98cea5986961822430175a%252Fpa%252FUC14598_dba6effaa88b21118f475a13722d793b.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_dba6effaa88b21118f475a13722d793b.jpg saved to cache
2026-03-28 21:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20
2026-03-28 21:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b841cb710>
2026-03-28 21:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20/ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20_image_2.jpg HTTP/1.1" 201 0
2026-03-28 21:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F21%252F0721e9d99e98cea5986961822430175a%252Fpa%252FUC14598_b31867a330e53c55caf1a4f575d3d3e5.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_b31867a330e53c55caf1a4f575d3d3e5.jpg saved to cache
2026-03-28 21:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20
2026-03-28 21:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_0d6b2e06df3cffea6c9c657f5edbea13.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_c47db53f307fba08454af06ad5a73ae9.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_014956fd2124929898f41cab05191b80.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_7054f2f86bdba136256bde041734a0ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b841d5010>
2026-03-28 21:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20/ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20_image_9.jpg HTTP/1.1" 201 0
2026-03-28 21:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F21%252F0721e9d99e98cea5986961822430175a%252Fpa%252FUC14598_0d6b2e06df3cffea6c9c657f5edbea13.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_0d6b2e06df3cffea6c9c657f5edbea13.jpg saved to cache
2026-03-28 21:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20
2026-03-28 21:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b840d1a90>
2026-03-28 21:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20/ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20_image_7.jpg HTTP/1.1" 201 0
2026-03-28 21:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F21%252F0721e9d99e98cea5986961822430175a%252Fpa%252FUC14598_c47db53f307fba08454af06ad5a73ae9.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_c47db53f307fba08454af06ad5a73ae9.jpg saved to cache
2026-03-28 21:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20
2026-03-28 21:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7f7110d0>
2026-03-28 21:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20/ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20_image_8.jpg HTTP/1.1" 201 0
2026-03-28 21:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F21%252F0721e9d99e98cea5986961822430175a%252Fpa%252FUC14598_014956fd2124929898f41cab05191b80.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_014956fd2124929898f41cab05191b80.jpg saved to cache
2026-03-28 21:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20
2026-03-28 21:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84230cd0>
2026-03-28 21:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20/ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20_image_0.jpg HTTP/1.1" 201 0
2026-03-28 21:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F21%252F0721e9d99e98cea5986961822430175a%252Fpa%252FUC14598_7054f2f86bdba136256bde041734a0ad.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_7054f2f86bdba136256bde041734a0ad.jpg saved to cache
2026-03-28 21:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20
2026-03-28 21:07:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20, skipping ID generation
2026-03-28 21:07:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20 with scrape type 1
2026-03-28 21:07:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20 sending to next pipeline
2026-03-28 21:07:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20, identifier: UC14598
2026-03-28 21:07:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20 with identifier: UC14598
2026-03-28 21:07:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20 with identifier: UC14598
2026-03-28 21:07:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20 with identifier: UC14598 to the API
2026-03-28 21:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_7054f2f86bdba136256bde041734a0ad.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.1L',
'engine_horse_power': 210,
'expiration_date': '2026-03-30T15:58:08Z',
'fuel_type': 'diesel',
'id': 'ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC14598',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'make': 'Alfa Romeo',
'model': 'Stelvio',
'odometer': 73527,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20/ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72351,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_7054f2f86bdba136256bde041734a0ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20/ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68935,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_04e30caab8ebab2ae4307ce8d14dff2b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20/ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71248,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_b31867a330e53c55caf1a4f575d3d3e5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20/ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56474,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_c8b63e0c93cb7ee67c4a377321f59147.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20/ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66752,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_8241585179025d2e89861e24132d3189.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20/ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73146,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_dba6effaa88b21118f475a13722d793b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20/ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48209,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_0c8b7463adce7b172255b8219abfdb73.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20/ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62220,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_c47db53f307fba08454af06ad5a73ae9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20/ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67462,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_014956fd2124929898f41cab05191b80.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20/ff5631fd-8388-5b2f-b8c5-ea5bb1db6d20_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63906,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/21/0721e9d99e98cea5986961822430175a/pa/UC14598_0d6b2e06df3cffea6c9c657f5edbea13.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-02-24',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Stelvio 2.2 JTDM Q4 Lusso',
'transmission': 'automatic',
'trim': 'Q4 Lusso',
'year': 2019}
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UC14598%27 HTTP/1.1" 200 None
2026-03-28 21:07:40 [auto1.it] INFO: Saving data for UC14598: {'created_time': 1774732060.301379, 'last_price_update_time': 1774732060.301389, 'auction_closing_time': 1774886288.0}
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UC14598') HTTP/1.1" 204 0
2026-03-28 21:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_cc841ece8c9f03570bccd90e6546706a.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RN27083/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ML45383/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ68257> (referer: https://www.auto1.com/v1/car-details-view/GZ68257/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RS27725/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GR46256> (referer: https://www.auto1.com/v1/car-details-view/GR46256/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b873a4550>
2026-03-28 21:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F17%252Fcd17794c9adfdc253c02c0c63607992c%252Fpa%252FPM85940_cc841ece8c9f03570bccd90e6546706a.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_cc841ece8c9f03570bccd90e6546706a.jpg saved to cache
2026-03-28 21:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6a570ab3-6667-528e-b703-805d6f07358d
2026-03-28 21:07:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f303330-d3c1-510b-b9c6-242ddbe29f58 with identifier: GZ68257
2026-03-28 21:07:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f303330-d3c1-510b-b9c6-242ddbe29f58 with scrape type 1
2026-03-28 21:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0f303330-d3c1-510b-b9c6-242ddbe29f58
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe5%252F83e5a44921f593ae5f6b51c46d01bf4c%252Fpa%252FGZ68257_8420bb2cd9a99f9b062c032f133bff12.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_8420bb2cd9a99f9b062c032f133bff12.jpg not downloaded yet
2026-03-28 21:07:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ddb31d7-5bb7-5315-9889-13740aa5aa6e with identifier: GR46256
2026-03-28 21:07:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ddb31d7-5bb7-5315-9889-13740aa5aa6e with scrape type 1
2026-03-28 21:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9ddb31d7-5bb7-5315-9889-13740aa5aa6e
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F61%252F5c6128249a66a972c79933540899682b%252Fpa%252FGR46256_431272279eead9b8d9eddeca91d1353f.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_431272279eead9b8d9eddeca91d1353f.jpg already downloaded
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F61%252F5c6128249a66a972c79933540899682b%252Fpa%252FGR46256_cfd3e0bb2d64489153fa450aa7b338ab.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_cfd3e0bb2d64489153fa450aa7b338ab.jpg already downloaded
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F61%252F5c6128249a66a972c79933540899682b%252Fpa%252FGR46256_abf6bf5b73684c3542dd7985c65f8059.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_abf6bf5b73684c3542dd7985c65f8059.jpg already downloaded
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F61%252F5c6128249a66a972c79933540899682b%252Fpa%252FGR46256_1417f6ac6abb1a98c812bb39a5ab4cd1.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_1417f6ac6abb1a98c812bb39a5ab4cd1.jpg already downloaded
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F61%252F5c6128249a66a972c79933540899682b%252Fpa%252FGR46256_b5cb782e017181042d4db3796f9fe6ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_b5cb782e017181042d4db3796f9fe6ad.jpg already downloaded
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F61%252F5c6128249a66a972c79933540899682b%252Fpa%252FGR46256_0cd27e403e7c3fc1c5a78786bcb7a538.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_0cd27e403e7c3fc1c5a78786bcb7a538.jpg already downloaded
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F61%252F5c6128249a66a972c79933540899682b%252Fpa%252FGR46256_b445ff86b0623d3fe18d711ab015926a.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_b445ff86b0623d3fe18d711ab015926a.jpg already downloaded
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F61%252F5c6128249a66a972c79933540899682b%252Fpa%252FGR46256_80ade0ce09488573d79835a42fa81896.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_80ade0ce09488573d79835a42fa81896.jpg already downloaded
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F61%252F5c6128249a66a972c79933540899682b%252Fpa%252FGR46256_be45e8cae140cf439bb511249e9f1980.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_be45e8cae140cf439bb511249e9f1980.jpg already downloaded
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F61%252F5c6128249a66a972c79933540899682b%252Fpa%252FGR46256_50cfdee73e012efc9191d4e7cafd80ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_50cfdee73e012efc9191d4e7cafd80ad.jpg already downloaded
2026-03-28 21:07:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9ddb31d7-5bb7-5315-9889-13740aa5aa6e, identifier: GR46256
2026-03-28 21:07:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9ddb31d7-5bb7-5315-9889-13740aa5aa6e with identifier: GR46256
2026-03-28 21:07:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9ddb31d7-5bb7-5315-9889-13740aa5aa6e with identifier: GR46256
2026-03-28 21:07:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9ddb31d7-5bb7-5315-9889-13740aa5aa6e with identifier: GR46256 to the API
2026-03-28 21:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GR46256>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.6L',
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:26:20Z',
'fuel_type': 'diesel',
'id': '9ddb31d7-5bb7-5315-9889-13740aa5aa6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR46256',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'make': 'Opel',
'model': 'Mokka',
'odometer': 159121,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_431272279eead9b8d9eddeca91d1353f.jpg',
'https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_cfd3e0bb2d64489153fa450aa7b338ab.jpg',
'https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_abf6bf5b73684c3542dd7985c65f8059.jpg',
'https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_1417f6ac6abb1a98c812bb39a5ab4cd1.jpg',
'https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_b5cb782e017181042d4db3796f9fe6ad.jpg',
'https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_0cd27e403e7c3fc1c5a78786bcb7a538.jpg',
'https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_b445ff86b0623d3fe18d711ab015926a.jpg',
'https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_80ade0ce09488573d79835a42fa81896.jpg',
'https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_be45e8cae140cf439bb511249e9f1980.jpg',
'https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_50cfdee73e012efc9191d4e7cafd80ad.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ddb31d7-5bb7-5315-9889-13740aa5aa6e/9ddb31d7-5bb7-5315-9889-13740aa5aa6e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69225,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_431272279eead9b8d9eddeca91d1353f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ddb31d7-5bb7-5315-9889-13740aa5aa6e/9ddb31d7-5bb7-5315-9889-13740aa5aa6e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57278,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_cfd3e0bb2d64489153fa450aa7b338ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ddb31d7-5bb7-5315-9889-13740aa5aa6e/9ddb31d7-5bb7-5315-9889-13740aa5aa6e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59817,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_abf6bf5b73684c3542dd7985c65f8059.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ddb31d7-5bb7-5315-9889-13740aa5aa6e/9ddb31d7-5bb7-5315-9889-13740aa5aa6e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41690,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_1417f6ac6abb1a98c812bb39a5ab4cd1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ddb31d7-5bb7-5315-9889-13740aa5aa6e/9ddb31d7-5bb7-5315-9889-13740aa5aa6e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59156,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_b5cb782e017181042d4db3796f9fe6ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ddb31d7-5bb7-5315-9889-13740aa5aa6e/9ddb31d7-5bb7-5315-9889-13740aa5aa6e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60771,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_0cd27e403e7c3fc1c5a78786bcb7a538.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ddb31d7-5bb7-5315-9889-13740aa5aa6e/9ddb31d7-5bb7-5315-9889-13740aa5aa6e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43474,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_b445ff86b0623d3fe18d711ab015926a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ddb31d7-5bb7-5315-9889-13740aa5aa6e/9ddb31d7-5bb7-5315-9889-13740aa5aa6e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59858,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_80ade0ce09488573d79835a42fa81896.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ddb31d7-5bb7-5315-9889-13740aa5aa6e/9ddb31d7-5bb7-5315-9889-13740aa5aa6e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66687,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_be45e8cae140cf439bb511249e9f1980.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ddb31d7-5bb7-5315-9889-13740aa5aa6e/9ddb31d7-5bb7-5315-9889-13740aa5aa6e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52680,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/61/5c6128249a66a972c79933540899682b/pa/GR46256_50cfdee73e012efc9191d4e7cafd80ad.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-04-18',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Mokka 1.6 CDTI DPF Cosmo',
'transmission': 'automatic',
'trim': 'Cosmo',
'year': 2016}
2026-03-28 21:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GR46256%27 HTTP/1.1" 200 None
2026-03-28 21:07:41 [auto1.it] INFO: Saving data for GR46256: {'created_time': 1774732061.745537, 'last_price_update_time': 1774732061.745549, 'auction_closing_time': 1774884380.0}
2026-03-28 21:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GR46256') HTTP/1.1" 204 0
2026-03-28 21:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_04c008f097bb13629fff03e6e4ddac8d.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe5%252F83e5a44921f593ae5f6b51c46d01bf4c%252Fpa%252FGZ68257_f0e8b651b869637184488eefde97e9c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_f0e8b651b869637184488eefde97e9c1.jpg not downloaded yet
2026-03-28 21:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_90455a86c66b68bb7ecd6ff62181e680.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe5%252F83e5a44921f593ae5f6b51c46d01bf4c%252Fpa%252FGZ68257_dad3547a5b09cb5e3c8634d534ff81a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_dad3547a5b09cb5e3c8634d534ff81a8.jpg not downloaded yet
2026-03-28 21:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UK60459/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe5%252F83e5a44921f593ae5f6b51c46d01bf4c%252Fpa%252FGZ68257_7aef8bc439c821f7269629800bf4b461.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_7aef8bc439c821f7269629800bf4b461.jpg not downloaded yet
2026-03-28 21:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe5%252F83e5a44921f593ae5f6b51c46d01bf4c%252Fpa%252FGZ68257_cba65b4ca88a8f6d9a70382a4c58b194.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_cba65b4ca88a8f6d9a70382a4c58b194.jpg not downloaded yet
2026-03-28 21:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe5%252F83e5a44921f593ae5f6b51c46d01bf4c%252Fpa%252FGZ68257_2b02759dc7a7dc58531c936e74e00385.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_2b02759dc7a7dc58531c936e74e00385.jpg not downloaded yet
2026-03-28 21:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_8420bb2cd9a99f9b062c032f133bff12.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe5%252F83e5a44921f593ae5f6b51c46d01bf4c%252Fpa%252FGZ68257_b5a5e624fe78e5e27f92c6fb0f79379e.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_b5a5e624fe78e5e27f92c6fb0f79379e.jpg not downloaded yet
2026-03-28 21:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7ee69e90>
2026-03-28 21:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 21:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F17%252Fcd17794c9adfdc253c02c0c63607992c%252Fpa%252FPM85940_04c008f097bb13629fff03e6e4ddac8d.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_04c008f097bb13629fff03e6e4ddac8d.jpg saved to cache
2026-03-28 21:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6a570ab3-6667-528e-b703-805d6f07358d
2026-03-28 21:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_f0e8b651b869637184488eefde97e9c1.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe5%252F83e5a44921f593ae5f6b51c46d01bf4c%252Fpa%252FGZ68257_c854e9629d166cf26cc7099c5cc2da84.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_c854e9629d166cf26cc7099c5cc2da84.jpg not downloaded yet
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8412ee90>
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F17%252Fcd17794c9adfdc253c02c0c63607992c%252Fpa%252FPM85940_90455a86c66b68bb7ecd6ff62181e680.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_90455a86c66b68bb7ecd6ff62181e680.jpg saved to cache
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6a570ab3-6667-528e-b703-805d6f07358d
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe5%252F83e5a44921f593ae5f6b51c46d01bf4c%252Fpa%252FGZ68257_b8dc4ea0a5c3d8f532cb499e74c57b8a.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_b8dc4ea0a5c3d8f532cb499e74c57b8a.jpg not downloaded yet
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe5%252F83e5a44921f593ae5f6b51c46d01bf4c%252Fpa%252FGZ68257_33214d87e055e774981c7fdfcc6d5524.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_33214d87e055e774981c7fdfcc6d5524.jpg not downloaded yet
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b842a3710>
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f303330-d3c1-510b-b9c6-242ddbe29f58/0f303330-d3c1-510b-b9c6-242ddbe29f58_image_0.jpg HTTP/1.1" 201 0
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe5%252F83e5a44921f593ae5f6b51c46d01bf4c%252Fpa%252FGZ68257_8420bb2cd9a99f9b062c032f133bff12.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_8420bb2cd9a99f9b062c032f133bff12.jpg saved to cache
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f303330-d3c1-510b-b9c6-242ddbe29f58
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7f7bffd0>
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f303330-d3c1-510b-b9c6-242ddbe29f58/0f303330-d3c1-510b-b9c6-242ddbe29f58_image_1.jpg HTTP/1.1" 201 0
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe5%252F83e5a44921f593ae5f6b51c46d01bf4c%252Fpa%252FGZ68257_f0e8b651b869637184488eefde97e9c1.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_f0e8b651b869637184488eefde97e9c1.jpg saved to cache
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f303330-d3c1-510b-b9c6-242ddbe29f58
2026-03-28 21:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_2b02759dc7a7dc58531c936e74e00385.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_b5a5e624fe78e5e27f92c6fb0f79379e.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_33214d87e055e774981c7fdfcc6d5524.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7f705510>
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f303330-d3c1-510b-b9c6-242ddbe29f58/0f303330-d3c1-510b-b9c6-242ddbe29f58_image_5.jpg HTTP/1.1" 201 0
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe5%252F83e5a44921f593ae5f6b51c46d01bf4c%252Fpa%252FGZ68257_2b02759dc7a7dc58531c936e74e00385.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_2b02759dc7a7dc58531c936e74e00385.jpg saved to cache
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f303330-d3c1-510b-b9c6-242ddbe29f58
2026-03-28 21:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_b8dc4ea0a5c3d8f532cb499e74c57b8a.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b841d78d0>
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f303330-d3c1-510b-b9c6-242ddbe29f58/0f303330-d3c1-510b-b9c6-242ddbe29f58_image_6.jpg HTTP/1.1" 201 0
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe5%252F83e5a44921f593ae5f6b51c46d01bf4c%252Fpa%252FGZ68257_b5a5e624fe78e5e27f92c6fb0f79379e.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_b5a5e624fe78e5e27f92c6fb0f79379e.jpg saved to cache
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0f303330-d3c1-510b-b9c6-242ddbe29f58
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7f7bfcd0>
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f303330-d3c1-510b-b9c6-242ddbe29f58/0f303330-d3c1-510b-b9c6-242ddbe29f58_image_9.jpg HTTP/1.1" 201 0
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe5%252F83e5a44921f593ae5f6b51c46d01bf4c%252Fpa%252FGZ68257_33214d87e055e774981c7fdfcc6d5524.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_33214d87e055e774981c7fdfcc6d5524.jpg saved to cache
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0f303330-d3c1-510b-b9c6-242ddbe29f58
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7f705ed0>
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f303330-d3c1-510b-b9c6-242ddbe29f58/0f303330-d3c1-510b-b9c6-242ddbe29f58_image_8.jpg HTTP/1.1" 201 0
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe5%252F83e5a44921f593ae5f6b51c46d01bf4c%252Fpa%252FGZ68257_b8dc4ea0a5c3d8f532cb499e74c57b8a.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_b8dc4ea0a5c3d8f532cb499e74c57b8a.jpg saved to cache
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0f303330-d3c1-510b-b9c6-242ddbe29f58
2026-03-28 21:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_c854e9629d166cf26cc7099c5cc2da84.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CG38373> (referer: https://www.auto1.com/v1/car-details-view/CG38373/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XS00387/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8429ea50>
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f303330-d3c1-510b-b9c6-242ddbe29f58/0f303330-d3c1-510b-b9c6-242ddbe29f58_image_7.jpg HTTP/1.1" 201 0
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe5%252F83e5a44921f593ae5f6b51c46d01bf4c%252Fpa%252FGZ68257_c854e9629d166cf26cc7099c5cc2da84.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_c854e9629d166cf26cc7099c5cc2da84.jpg saved to cache
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0f303330-d3c1-510b-b9c6-242ddbe29f58
2026-03-28 21:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AW19697/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_7aef8bc439c821f7269629800bf4b461.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_cba65b4ca88a8f6d9a70382a4c58b194.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcef5440-39af-5a73-a9f0-cd9991beda78 with identifier: CG38373
2026-03-28 21:07:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcef5440-39af-5a73-a9f0-cd9991beda78 with scrape type 1
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dcef5440-39af-5a73-a9f0-cd9991beda78
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F70%252Ff07038d1a29dbd484a9bc76f7411f4ba%252Fpa%252FCG38373_66c2c7f898d5d1b010e43de5f3c6c6eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_66c2c7f898d5d1b010e43de5f3c6c6eb.jpg already downloaded
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F70%252Ff07038d1a29dbd484a9bc76f7411f4ba%252Fpa%252FCG38373_0578f90a90ff47ccb177105dc94592e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_0578f90a90ff47ccb177105dc94592e3.jpg already downloaded
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F70%252Ff07038d1a29dbd484a9bc76f7411f4ba%252Fpa%252FCG38373_f1124173a717e4f7503d7e6c009d9a5f.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_f1124173a717e4f7503d7e6c009d9a5f.jpg already downloaded
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F70%252Ff07038d1a29dbd484a9bc76f7411f4ba%252Fpa%252FCG38373_9fdcec7f0e12a0a603223b393237abf7.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_9fdcec7f0e12a0a603223b393237abf7.jpg already downloaded
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F70%252Ff07038d1a29dbd484a9bc76f7411f4ba%252Fpa%252FCG38373_50fbba8e444d56f3aae13a78753a7c74.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_50fbba8e444d56f3aae13a78753a7c74.jpg already downloaded
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F70%252Ff07038d1a29dbd484a9bc76f7411f4ba%252Fpa%252FCG38373_444979272d46acfe6b57d5c42c3833b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_444979272d46acfe6b57d5c42c3833b9.jpg already downloaded
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F70%252Ff07038d1a29dbd484a9bc76f7411f4ba%252Fpa%252FCG38373_2f3e6f75dce26566482ab75a0a0f6c99.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_2f3e6f75dce26566482ab75a0a0f6c99.jpg already downloaded
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F70%252Ff07038d1a29dbd484a9bc76f7411f4ba%252Fpa%252FCG38373_01aaa28fa17639df4282dd281b70781f.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_01aaa28fa17639df4282dd281b70781f.jpg already downloaded
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F70%252Ff07038d1a29dbd484a9bc76f7411f4ba%252Fpa%252FCG38373_19aa5a38b61a8dd6d8e89bfc402e68b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_19aa5a38b61a8dd6d8e89bfc402e68b4.jpg already downloaded
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F70%252Ff07038d1a29dbd484a9bc76f7411f4ba%252Fpa%252FCG38373_e1afbfc5e8e7bcc72b056eb66738323c.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_e1afbfc5e8e7bcc72b056eb66738323c.jpg already downloaded
2026-03-28 21:07:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dcef5440-39af-5a73-a9f0-cd9991beda78, identifier: CG38373
2026-03-28 21:07:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dcef5440-39af-5a73-a9f0-cd9991beda78 with identifier: CG38373
2026-03-28 21:07:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dcef5440-39af-5a73-a9f0-cd9991beda78 with identifier: CG38373
2026-03-28 21:07:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dcef5440-39af-5a73-a9f0-cd9991beda78 with identifier: CG38373 to the API
2026-03-28 21:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CG38373>
{'auction_title': '',
'c_o_2_emission_value': 102,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:01:50Z',
'fuel_type': 'diesel',
'id': 'dcef5440-39af-5a73-a9f0-cd9991beda78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG38373',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 237856,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_66c2c7f898d5d1b010e43de5f3c6c6eb.jpg',
'https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_0578f90a90ff47ccb177105dc94592e3.jpg',
'https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_f1124173a717e4f7503d7e6c009d9a5f.jpg',
'https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_9fdcec7f0e12a0a603223b393237abf7.jpg',
'https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_50fbba8e444d56f3aae13a78753a7c74.jpg',
'https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_444979272d46acfe6b57d5c42c3833b9.jpg',
'https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_2f3e6f75dce26566482ab75a0a0f6c99.jpg',
'https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_01aaa28fa17639df4282dd281b70781f.jpg',
'https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_19aa5a38b61a8dd6d8e89bfc402e68b4.jpg',
'https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_e1afbfc5e8e7bcc72b056eb66738323c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcef5440-39af-5a73-a9f0-cd9991beda78/dcef5440-39af-5a73-a9f0-cd9991beda78_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2570111,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_66c2c7f898d5d1b010e43de5f3c6c6eb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcef5440-39af-5a73-a9f0-cd9991beda78/dcef5440-39af-5a73-a9f0-cd9991beda78_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2454640,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_0578f90a90ff47ccb177105dc94592e3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcef5440-39af-5a73-a9f0-cd9991beda78/dcef5440-39af-5a73-a9f0-cd9991beda78_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57082,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_f1124173a717e4f7503d7e6c009d9a5f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcef5440-39af-5a73-a9f0-cd9991beda78/dcef5440-39af-5a73-a9f0-cd9991beda78_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2225339,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_9fdcec7f0e12a0a603223b393237abf7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcef5440-39af-5a73-a9f0-cd9991beda78/dcef5440-39af-5a73-a9f0-cd9991beda78_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62296,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_50fbba8e444d56f3aae13a78753a7c74.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcef5440-39af-5a73-a9f0-cd9991beda78/dcef5440-39af-5a73-a9f0-cd9991beda78_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65452,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_444979272d46acfe6b57d5c42c3833b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcef5440-39af-5a73-a9f0-cd9991beda78/dcef5440-39af-5a73-a9f0-cd9991beda78_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62308,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_2f3e6f75dce26566482ab75a0a0f6c99.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcef5440-39af-5a73-a9f0-cd9991beda78/dcef5440-39af-5a73-a9f0-cd9991beda78_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2534385,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_01aaa28fa17639df4282dd281b70781f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcef5440-39af-5a73-a9f0-cd9991beda78/dcef5440-39af-5a73-a9f0-cd9991beda78_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2538560,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_19aa5a38b61a8dd6d8e89bfc402e68b4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcef5440-39af-5a73-a9f0-cd9991beda78/dcef5440-39af-5a73-a9f0-cd9991beda78_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2316033,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/70/f07038d1a29dbd484a9bc76f7411f4ba/pa/CG38373_e1afbfc5e8e7bcc72b056eb66738323c.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-12-16',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Highline BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Highline BlueMotion Tech',
'year': 2013}
2026-03-28 21:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CG38373%27 HTTP/1.1" 200 None
2026-03-28 21:07:44 [auto1.it] INFO: Saving data for CG38373: {'created_time': 1774732064.37511, 'last_price_update_time': 1774732064.375123, 'auction_closing_time': 1774882910.0}
2026-03-28 21:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CG38373') HTTP/1.1" 204 0
2026-03-28 21:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_dad3547a5b09cb5e3c8634d534ff81a8.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MD59623/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NC22560> (referer: https://www.auto1.com/v1/car-details-view/NC22560/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YX84472/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KN28324> (referer: https://www.auto1.com/v1/car-details-view/KN28324/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84142690>
2026-03-28 21:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f303330-d3c1-510b-b9c6-242ddbe29f58/0f303330-d3c1-510b-b9c6-242ddbe29f58_image_3.jpg HTTP/1.1" 201 0
2026-03-28 21:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe5%252F83e5a44921f593ae5f6b51c46d01bf4c%252Fpa%252FGZ68257_7aef8bc439c821f7269629800bf4b461.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_7aef8bc439c821f7269629800bf4b461.jpg saved to cache
2026-03-28 21:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f303330-d3c1-510b-b9c6-242ddbe29f58
2026-03-28 21:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7ee35890>
2026-03-28 21:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f303330-d3c1-510b-b9c6-242ddbe29f58/0f303330-d3c1-510b-b9c6-242ddbe29f58_image_4.jpg HTTP/1.1" 201 0
2026-03-28 21:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe5%252F83e5a44921f593ae5f6b51c46d01bf4c%252Fpa%252FGZ68257_cba65b4ca88a8f6d9a70382a4c58b194.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_cba65b4ca88a8f6d9a70382a4c58b194.jpg saved to cache
2026-03-28 21:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f303330-d3c1-510b-b9c6-242ddbe29f58
2026-03-28 21:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b841f3050>
2026-03-28 21:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f303330-d3c1-510b-b9c6-242ddbe29f58/0f303330-d3c1-510b-b9c6-242ddbe29f58_image_2.jpg HTTP/1.1" 201 0
2026-03-28 21:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Fe5%252F83e5a44921f593ae5f6b51c46d01bf4c%252Fpa%252FGZ68257_dad3547a5b09cb5e3c8634d534ff81a8.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_dad3547a5b09cb5e3c8634d534ff81a8.jpg saved to cache
2026-03-28 21:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f303330-d3c1-510b-b9c6-242ddbe29f58
2026-03-28 21:07:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f303330-d3c1-510b-b9c6-242ddbe29f58, skipping ID generation
2026-03-28 21:07:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f303330-d3c1-510b-b9c6-242ddbe29f58 with scrape type 1
2026-03-28 21:07:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f303330-d3c1-510b-b9c6-242ddbe29f58 sending to next pipeline
2026-03-28 21:07:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0f303330-d3c1-510b-b9c6-242ddbe29f58, identifier: GZ68257
2026-03-28 21:07:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0f303330-d3c1-510b-b9c6-242ddbe29f58 with identifier: GZ68257
2026-03-28 21:07:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0f303330-d3c1-510b-b9c6-242ddbe29f58 with identifier: GZ68257
2026-03-28 21:07:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0f303330-d3c1-510b-b9c6-242ddbe29f58 with identifier: GZ68257 to the API
2026-03-28 21:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_dad3547a5b09cb5e3c8634d534ff81a8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:01:49Z',
'fuel_type': 'petrol',
'id': '0f303330-d3c1-510b-b9c6-242ddbe29f58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ68257',
'listing': 'auction',
'location': 'IT, Legnano',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 88530,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f303330-d3c1-510b-b9c6-242ddbe29f58/0f303330-d3c1-510b-b9c6-242ddbe29f58_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69429,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_8420bb2cd9a99f9b062c032f133bff12.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f303330-d3c1-510b-b9c6-242ddbe29f58/0f303330-d3c1-510b-b9c6-242ddbe29f58_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68641,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_f0e8b651b869637184488eefde97e9c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f303330-d3c1-510b-b9c6-242ddbe29f58/0f303330-d3c1-510b-b9c6-242ddbe29f58_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64425,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_dad3547a5b09cb5e3c8634d534ff81a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f303330-d3c1-510b-b9c6-242ddbe29f58/0f303330-d3c1-510b-b9c6-242ddbe29f58_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49057,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_7aef8bc439c821f7269629800bf4b461.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f303330-d3c1-510b-b9c6-242ddbe29f58/0f303330-d3c1-510b-b9c6-242ddbe29f58_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58107,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_cba65b4ca88a8f6d9a70382a4c58b194.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f303330-d3c1-510b-b9c6-242ddbe29f58/0f303330-d3c1-510b-b9c6-242ddbe29f58_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62643,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_2b02759dc7a7dc58531c936e74e00385.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f303330-d3c1-510b-b9c6-242ddbe29f58/0f303330-d3c1-510b-b9c6-242ddbe29f58_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51377,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_b5a5e624fe78e5e27f92c6fb0f79379e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f303330-d3c1-510b-b9c6-242ddbe29f58/0f303330-d3c1-510b-b9c6-242ddbe29f58_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67122,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_c854e9629d166cf26cc7099c5cc2da84.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f303330-d3c1-510b-b9c6-242ddbe29f58/0f303330-d3c1-510b-b9c6-242ddbe29f58_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67585,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_b8dc4ea0a5c3d8f532cb499e74c57b8a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f303330-d3c1-510b-b9c6-242ddbe29f58/0f303330-d3c1-510b-b9c6-242ddbe29f58_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52294,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/e5/83e5a44921f593ae5f6b51c46d01bf4c/pa/GZ68257_33214d87e055e774981c7fdfcc6d5524.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-04-20',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 Sportback 1.4 TFSI Ambiente',
'transmission': 'automatic',
'trim': 'Ambiente',
'year': 2011}
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ68257%27 HTTP/1.1" 200 None
2026-03-28 21:07:45 [auto1.it] INFO: Saving data for GZ68257: {'created_time': 1774732065.011199, 'last_price_update_time': 1774732065.011212, 'auction_closing_time': 1774882909.0}
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GZ68257') HTTP/1.1" 204 0
2026-03-28 21:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_443336954f139e0578927ed279f3c0be.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0501cad-3902-50d7-965a-215a7e41e9f2 with identifier: NC22560
2026-03-28 21:07:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0501cad-3902-50d7-965a-215a7e41e9f2 with scrape type 1
2026-03-28 21:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f0501cad-3902-50d7-965a-215a7e41e9f2
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F7b%252F497b3713317451f19a61afb2eabcc56d%252Fpa%252FNC22560_1e04e451afb7cb9f5c7e2c7f6ac69317.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_1e04e451afb7cb9f5c7e2c7f6ac69317.jpg not downloaded yet
2026-03-28 21:07:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cc406c2-7cff-5362-af7d-66af4c4d7c10 with identifier: KN28324
2026-03-28 21:07:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cc406c2-7cff-5362-af7d-66af4c4d7c10 with scrape type 1
2026-03-28 21:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5cc406c2-7cff-5362-af7d-66af4c4d7c10
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Ffa%252Fe8fac4beb27c6b373fccbdce40fbacc3%252Fpa%252FKN28324_ce237352d932e2c1d279221e216b4e5f.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_ce237352d932e2c1d279221e216b4e5f.jpg already downloaded
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Ffa%252Fe8fac4beb27c6b373fccbdce40fbacc3%252Fpa%252FKN28324_e6a5be1a113c5218d40c957b553eccdb.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_e6a5be1a113c5218d40c957b553eccdb.jpg already downloaded
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Ffa%252Fe8fac4beb27c6b373fccbdce40fbacc3%252Fpa%252FKN28324_a94fa201113e26024ca8aa3c71ecd22b.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_a94fa201113e26024ca8aa3c71ecd22b.jpg already downloaded
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Ffa%252Fe8fac4beb27c6b373fccbdce40fbacc3%252Fpa%252FKN28324_1c0081458164fd3f8d49cd4ace60ef56.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_1c0081458164fd3f8d49cd4ace60ef56.jpg already downloaded
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Ffa%252Fe8fac4beb27c6b373fccbdce40fbacc3%252Fpa%252FKN28324_03f25ef1c04c4e1205e941317d0402fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_03f25ef1c04c4e1205e941317d0402fa.jpg already downloaded
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Ffa%252Fe8fac4beb27c6b373fccbdce40fbacc3%252Fpa%252FKN28324_3a8a0627a6d305a8b61b55a46c9f359a.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_3a8a0627a6d305a8b61b55a46c9f359a.jpg already downloaded
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Ffa%252Fe8fac4beb27c6b373fccbdce40fbacc3%252Fpa%252FKN28324_81c8200f6bfe21ae85d1f2803e629014.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_81c8200f6bfe21ae85d1f2803e629014.jpg already downloaded
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Ffa%252Fe8fac4beb27c6b373fccbdce40fbacc3%252Fpa%252FKN28324_0318987c59120b140a84adc5bcc7bdc1.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_0318987c59120b140a84adc5bcc7bdc1.jpg already downloaded
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Ffa%252Fe8fac4beb27c6b373fccbdce40fbacc3%252Fpa%252FKN28324_c7d9ef8b0a2e465f0cc0d3de97d6a75a.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_c7d9ef8b0a2e465f0cc0d3de97d6a75a.jpg already downloaded
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Ffa%252Fe8fac4beb27c6b373fccbdce40fbacc3%252Fpa%252FKN28324_fc3d7464bf8c6987fe59777c1c4cb63e.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_fc3d7464bf8c6987fe59777c1c4cb63e.jpg already downloaded
2026-03-28 21:07:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5cc406c2-7cff-5362-af7d-66af4c4d7c10, identifier: KN28324
2026-03-28 21:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_e7a6f9f128f5b49c49685ed78183ee19.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5cc406c2-7cff-5362-af7d-66af4c4d7c10 with identifier: KN28324
2026-03-28 21:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5cc406c2-7cff-5362-af7d-66af4c4d7c10 with identifier: KN28324
2026-03-28 21:07:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5cc406c2-7cff-5362-af7d-66af4c4d7c10 with identifier: KN28324 to the API
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KN28324>
{'auction_title': '',
'c_o_2_emission_value': 143,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:13:21Z',
'fuel_type': 'petrol',
'id': '5cc406c2-7cff-5362-af7d-66af4c4d7c10',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN28324',
'listing': 'auction',
'location': 'IT',
'make': 'Opel',
'model': 'Meriva',
'odometer': 144621,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 13,
'photo_urls': ['https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_ce237352d932e2c1d279221e216b4e5f.jpg',
'https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_e6a5be1a113c5218d40c957b553eccdb.jpg',
'https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_a94fa201113e26024ca8aa3c71ecd22b.jpg',
'https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_1c0081458164fd3f8d49cd4ace60ef56.jpg',
'https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_03f25ef1c04c4e1205e941317d0402fa.jpg',
'https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_3a8a0627a6d305a8b61b55a46c9f359a.jpg',
'https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_81c8200f6bfe21ae85d1f2803e629014.jpg',
'https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_0318987c59120b140a84adc5bcc7bdc1.jpg',
'https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_c7d9ef8b0a2e465f0cc0d3de97d6a75a.jpg',
'https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_fc3d7464bf8c6987fe59777c1c4cb63e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cc406c2-7cff-5362-af7d-66af4c4d7c10/5cc406c2-7cff-5362-af7d-66af4c4d7c10_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 156387,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_ce237352d932e2c1d279221e216b4e5f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cc406c2-7cff-5362-af7d-66af4c4d7c10/5cc406c2-7cff-5362-af7d-66af4c4d7c10_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 156387,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_e6a5be1a113c5218d40c957b553eccdb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cc406c2-7cff-5362-af7d-66af4c4d7c10/5cc406c2-7cff-5362-af7d-66af4c4d7c10_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 135511,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_a94fa201113e26024ca8aa3c71ecd22b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cc406c2-7cff-5362-af7d-66af4c4d7c10/5cc406c2-7cff-5362-af7d-66af4c4d7c10_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115683,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_1c0081458164fd3f8d49cd4ace60ef56.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cc406c2-7cff-5362-af7d-66af4c4d7c10/5cc406c2-7cff-5362-af7d-66af4c4d7c10_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 132108,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_03f25ef1c04c4e1205e941317d0402fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cc406c2-7cff-5362-af7d-66af4c4d7c10/5cc406c2-7cff-5362-af7d-66af4c4d7c10_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121143,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_3a8a0627a6d305a8b61b55a46c9f359a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cc406c2-7cff-5362-af7d-66af4c4d7c10/5cc406c2-7cff-5362-af7d-66af4c4d7c10_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 129227,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_81c8200f6bfe21ae85d1f2803e629014.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cc406c2-7cff-5362-af7d-66af4c4d7c10/5cc406c2-7cff-5362-af7d-66af4c4d7c10_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123970,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_0318987c59120b140a84adc5bcc7bdc1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cc406c2-7cff-5362-af7d-66af4c4d7c10/5cc406c2-7cff-5362-af7d-66af4c4d7c10_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85947,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_c7d9ef8b0a2e465f0cc0d3de97d6a75a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cc406c2-7cff-5362-af7d-66af4c4d7c10/5cc406c2-7cff-5362-af7d-66af4c4d7c10_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87867,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/fa/e8fac4beb27c6b373fccbdce40fbacc3/pa/KN28324_fc3d7464bf8c6987fe59777c1c4cb63e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-02-21',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Meriva 1.4 Elective',
'transmission': 'manual',
'trim': 'Elective',
'year': 2013}
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KN28324%27 HTTP/1.1" 200 None
2026-03-28 21:07:45 [auto1.it] INFO: Saving data for KN28324: {'created_time': 1774732065.691842, 'last_price_update_time': 1774732065.691852, 'auction_closing_time': 1774883601.0}
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KN28324') HTTP/1.1" 204 0
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F7b%252F497b3713317451f19a61afb2eabcc56d%252Fpa%252FNC22560_903eb30e5b3cc10f9aae1b9c8d94954b.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_903eb30e5b3cc10f9aae1b9c8d94954b.jpg not downloaded yet
2026-03-28 21:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TB63135> (referer: https://www.auto1.com/v1/car-details-view/TB63135/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F7b%252F497b3713317451f19a61afb2eabcc56d%252Fpa%252FNC22560_7fc803ebbe8b06231929818ae1641b74.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_7fc803ebbe8b06231929818ae1641b74.jpg not downloaded yet
2026-03-28 21:07:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b842dabd0>
2026-03-28 21:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F17%252Fcd17794c9adfdc253c02c0c63607992c%252Fpa%252FPM85940_443336954f139e0578927ed279f3c0be.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_443336954f139e0578927ed279f3c0be.jpg saved to cache
2026-03-28 21:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6a570ab3-6667-528e-b703-805d6f07358d
2026-03-28 21:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84255ed0>
2026-03-28 21:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F17%252Fcd17794c9adfdc253c02c0c63607992c%252Fpa%252FPM85940_e7a6f9f128f5b49c49685ed78183ee19.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_e7a6f9f128f5b49c49685ed78183ee19.jpg saved to cache
2026-03-28 21:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6a570ab3-6667-528e-b703-805d6f07358d
2026-03-28 21:07:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6a570ab3-6667-528e-b703-805d6f07358d, skipping ID generation
2026-03-28 21:07:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a570ab3-6667-528e-b703-805d6f07358d with scrape type 1
2026-03-28 21:07:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6a570ab3-6667-528e-b703-805d6f07358d sending to next pipeline
2026-03-28 21:07:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6a570ab3-6667-528e-b703-805d6f07358d, identifier: PM85940
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F7b%252F497b3713317451f19a61afb2eabcc56d%252Fpa%252FNC22560_3b0f16923dd705d4a1bb19309ac2bbd0.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_3b0f16923dd705d4a1bb19309ac2bbd0.jpg not downloaded yet
2026-03-28 21:07:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6a570ab3-6667-528e-b703-805d6f07358d with identifier: PM85940
2026-03-28 21:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6a570ab3-6667-528e-b703-805d6f07358d with identifier: PM85940
2026-03-28 21:07:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6a570ab3-6667-528e-b703-805d6f07358d with identifier: PM85940 to the API
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_e7a6f9f128f5b49c49685ed78183ee19.jpg>
{'auction_title': '',
'c_o_2_emission_value': 179,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:13:31Z',
'fuel_type': 'diesel',
'id': '6a570ab3-6667-528e-b703-805d6f07358d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM85940',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Ford',
'model': 'Kuga',
'odometer': 113138,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99666,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_c4ebf98679e26862fd9a24c1fa27f840.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100623,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_e7a6f9f128f5b49c49685ed78183ee19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66533,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_443336954f139e0578927ed279f3c0be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59736,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_b681769933655521f831a7d3ed38355d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65077,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_90455a86c66b68bb7ecd6ff62181e680.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71331,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_8da0cb82a5d4cd8ceb4fe51f5805a465.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53378,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_04c008f097bb13629fff03e6e4ddac8d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79368,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_cc841ece8c9f03570bccd90e6546706a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89582,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_dba9118eccce288a0afe4def364d0bf4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68354,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_76e253e2607a7aa822052374cc245fe7.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-08-24',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2011}
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM85940%27 HTTP/1.1" 200 None
2026-03-28 21:07:46 [auto1.it] INFO: Saving data for PM85940: {'created_time': 1774732066.262207, 'last_price_update_time': 1774732066.262223, 'auction_closing_time': 1774883611.0}
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PM85940') HTTP/1.1" 204 0
2026-03-28 21:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NF72135/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F7b%252F497b3713317451f19a61afb2eabcc56d%252Fpa%252FNC22560_44aac1c4c3a45ef9168d07e7d783c6fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_44aac1c4c3a45ef9168d07e7d783c6fe.jpg not downloaded yet
2026-03-28 21:07:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SX65477/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CY56164> (referer: https://www.auto1.com/v1/car-details-view/CY56164/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XP44684/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c66a6720-7405-57a2-9886-f4a142201ba3 with identifier: TB63135
2026-03-28 21:07:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c66a6720-7405-57a2-9886-f4a142201ba3 with scrape type 1
2026-03-28 21:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c66a6720-7405-57a2-9886-f4a142201ba3
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F98%252Fc1986d50443b1b4f3a3c5a7626624f06%252Fpa%252FTB63135_80ea73a82d3144d51606cc86a329621d.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_80ea73a82d3144d51606cc86a329621d.jpg already downloaded
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F98%252Fc1986d50443b1b4f3a3c5a7626624f06%252Fpa%252FTB63135_e5474598439d3ad22bba6f2f203283fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_e5474598439d3ad22bba6f2f203283fb.jpg already downloaded
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F98%252Fc1986d50443b1b4f3a3c5a7626624f06%252Fpa%252FTB63135_f3a761575141a8728e40a4d3e9a8266b.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_f3a761575141a8728e40a4d3e9a8266b.jpg already downloaded
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F98%252Fc1986d50443b1b4f3a3c5a7626624f06%252Fpa%252FTB63135_910950285a56691b03c6fc3b844260b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_910950285a56691b03c6fc3b844260b0.jpg already downloaded
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F98%252Fc1986d50443b1b4f3a3c5a7626624f06%252Fpa%252FTB63135_b0515f98d7dcb0f9c0c25c645c7c24b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_b0515f98d7dcb0f9c0c25c645c7c24b4.jpg already downloaded
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F98%252Fc1986d50443b1b4f3a3c5a7626624f06%252Fpa%252FTB63135_2b8717b2b0ca2993494f2fc0fbdccc27.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_2b8717b2b0ca2993494f2fc0fbdccc27.jpg already downloaded
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F98%252Fc1986d50443b1b4f3a3c5a7626624f06%252Fpa%252FTB63135_4566ee325252fd22db0194cbeb44d7ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_4566ee325252fd22db0194cbeb44d7ae.jpg already downloaded
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F98%252Fc1986d50443b1b4f3a3c5a7626624f06%252Fpa%252FTB63135_b6806f264b85e14f6dd6093c3a3ca696.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_b6806f264b85e14f6dd6093c3a3ca696.jpg already downloaded
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F98%252Fc1986d50443b1b4f3a3c5a7626624f06%252Fpa%252FTB63135_5bb1f8957476b0cd68df026fb3c2b814.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_5bb1f8957476b0cd68df026fb3c2b814.jpg already downloaded
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F98%252Fc1986d50443b1b4f3a3c5a7626624f06%252Fpa%252FTB63135_bcda06d0058da8d4838c15743596fd6f.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_bcda06d0058da8d4838c15743596fd6f.jpg already downloaded
2026-03-28 21:07:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c66a6720-7405-57a2-9886-f4a142201ba3, identifier: TB63135
2026-03-28 21:07:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c66a6720-7405-57a2-9886-f4a142201ba3 with identifier: TB63135
2026-03-28 21:07:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c66a6720-7405-57a2-9886-f4a142201ba3 with identifier: TB63135
2026-03-28 21:07:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c66a6720-7405-57a2-9886-f4a142201ba3 with identifier: TB63135 to the API
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TB63135>
{'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:20:58Z',
'fuel_type': 'diesel',
'id': 'c66a6720-7405-57a2-9886-f4a142201ba3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB63135',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'make': 'Ford',
'model': 'Focus',
'odometer': 138370,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_80ea73a82d3144d51606cc86a329621d.jpg',
'https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_e5474598439d3ad22bba6f2f203283fb.jpg',
'https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_f3a761575141a8728e40a4d3e9a8266b.jpg',
'https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_910950285a56691b03c6fc3b844260b0.jpg',
'https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_b0515f98d7dcb0f9c0c25c645c7c24b4.jpg',
'https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_2b8717b2b0ca2993494f2fc0fbdccc27.jpg',
'https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_4566ee325252fd22db0194cbeb44d7ae.jpg',
'https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_b6806f264b85e14f6dd6093c3a3ca696.jpg',
'https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_5bb1f8957476b0cd68df026fb3c2b814.jpg',
'https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_bcda06d0058da8d4838c15743596fd6f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c66a6720-7405-57a2-9886-f4a142201ba3/c66a6720-7405-57a2-9886-f4a142201ba3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72017,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_80ea73a82d3144d51606cc86a329621d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c66a6720-7405-57a2-9886-f4a142201ba3/c66a6720-7405-57a2-9886-f4a142201ba3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57060,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_e5474598439d3ad22bba6f2f203283fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c66a6720-7405-57a2-9886-f4a142201ba3/c66a6720-7405-57a2-9886-f4a142201ba3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70985,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_f3a761575141a8728e40a4d3e9a8266b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c66a6720-7405-57a2-9886-f4a142201ba3/c66a6720-7405-57a2-9886-f4a142201ba3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46289,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_910950285a56691b03c6fc3b844260b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c66a6720-7405-57a2-9886-f4a142201ba3/c66a6720-7405-57a2-9886-f4a142201ba3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70447,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_b0515f98d7dcb0f9c0c25c645c7c24b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c66a6720-7405-57a2-9886-f4a142201ba3/c66a6720-7405-57a2-9886-f4a142201ba3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72190,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_2b8717b2b0ca2993494f2fc0fbdccc27.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c66a6720-7405-57a2-9886-f4a142201ba3/c66a6720-7405-57a2-9886-f4a142201ba3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50554,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_4566ee325252fd22db0194cbeb44d7ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c66a6720-7405-57a2-9886-f4a142201ba3/c66a6720-7405-57a2-9886-f4a142201ba3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69981,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_b6806f264b85e14f6dd6093c3a3ca696.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c66a6720-7405-57a2-9886-f4a142201ba3/c66a6720-7405-57a2-9886-f4a142201ba3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71997,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_5bb1f8957476b0cd68df026fb3c2b814.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c66a6720-7405-57a2-9886-f4a142201ba3/c66a6720-7405-57a2-9886-f4a142201ba3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73891,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/98/c1986d50443b1b4f3a3c5a7626624f06/pa/TB63135_bcda06d0058da8d4838c15743596fd6f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-08-29',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 2.0 TDCi ST-Line',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2017}
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB63135%27 HTTP/1.1" 200 None
2026-03-28 21:07:46 [auto1.it] INFO: Saving data for TB63135: {'created_time': 1774732066.959233, 'last_price_update_time': 1774732066.959244, 'auction_closing_time': 1774884058.0}
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TB63135') HTTP/1.1" 204 0
2026-03-28 21:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_903eb30e5b3cc10f9aae1b9c8d94954b.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F7b%252F497b3713317451f19a61afb2eabcc56d%252Fpa%252FNC22560_61a1779d7410ca90c899f6e680b40c2a.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_61a1779d7410ca90c899f6e680b40c2a.jpg not downloaded yet
2026-03-28 21:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RS27725> (referer: https://www.auto1.com/v1/car-details-view/RS27725/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UK60459> (referer: https://www.auto1.com/v1/car-details-view/UK60459/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81530959-605c-535f-b6f7-1f7bdfec6fc4 with identifier: CY56164
2026-03-28 21:07:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81530959-605c-535f-b6f7-1f7bdfec6fc4 with scrape type 1
2026-03-28 21:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 81530959-605c-535f-b6f7-1f7bdfec6fc4
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F90%252Fa9909a0300bce01faae40b5855ada059%252Fpa%252FCY56164_02cf2003a13e33023733eb6f51a2a0cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_02cf2003a13e33023733eb6f51a2a0cb.jpg not downloaded yet
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F7b%252F497b3713317451f19a61afb2eabcc56d%252Fpa%252FNC22560_d8b6290ffcba83e37bde4738151d5c19.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_d8b6290ffcba83e37bde4738151d5c19.jpg not downloaded yet
2026-03-28 21:07:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F90%252Fa9909a0300bce01faae40b5855ada059%252Fpa%252FCY56164_42072b7cfbfb9b72fb87eb2190155ad8.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_42072b7cfbfb9b72fb87eb2190155ad8.jpg not downloaded yet
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F7b%252F497b3713317451f19a61afb2eabcc56d%252Fpa%252FNC22560_80a75a5fbbdca1ab30ce1c7e16c1bf09.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_80a75a5fbbdca1ab30ce1c7e16c1bf09.jpg not downloaded yet
2026-03-28 21:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_1e04e451afb7cb9f5c7e2c7f6ac69317.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F90%252Fa9909a0300bce01faae40b5855ada059%252Fpa%252FCY56164_350021c844761f684e5fc3e767631c93.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_350021c844761f684e5fc3e767631c93.jpg not downloaded yet
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F7b%252F497b3713317451f19a61afb2eabcc56d%252Fpa%252FNC22560_0141af47aa3bf121d1c23de24026a9ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_0141af47aa3bf121d1c23de24026a9ac.jpg not downloaded yet
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F90%252Fa9909a0300bce01faae40b5855ada059%252Fpa%252FCY56164_f266668d4535b502d39815f1cab87878.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_f266668d4535b502d39815f1cab87878.jpg not downloaded yet
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F7b%252F497b3713317451f19a61afb2eabcc56d%252Fpa%252FNC22560_b01dde6955815c690ea4f304881e8ac9.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_b01dde6955815c690ea4f304881e8ac9.jpg not downloaded yet
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F90%252Fa9909a0300bce01faae40b5855ada059%252Fpa%252FCY56164_11af315dc2b5bce77fbc4d25dd9a209a.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_11af315dc2b5bce77fbc4d25dd9a209a.jpg not downloaded yet
2026-03-28 21:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7ee0be50>
2026-03-28 21:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0501cad-3902-50d7-965a-215a7e41e9f2/f0501cad-3902-50d7-965a-215a7e41e9f2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F7b%252F497b3713317451f19a61afb2eabcc56d%252Fpa%252FNC22560_903eb30e5b3cc10f9aae1b9c8d94954b.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_903eb30e5b3cc10f9aae1b9c8d94954b.jpg saved to cache
2026-03-28 21:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f0501cad-3902-50d7-965a-215a7e41e9f2
2026-03-28 21:07:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 537ae8d4-ddab-56b4-a650-f2573e594a02 with identifier: RS27725
2026-03-28 21:07:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 537ae8d4-ddab-56b4-a650-f2573e594a02 with scrape type 1
2026-03-28 21:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 537ae8d4-ddab-56b4-a650-f2573e594a02
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fed%252F33ed45d00c07235904ef33e641f93af2%252Fpa%252FRS27725_062a7f20ef3114294cd6eaafb263b544.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_062a7f20ef3114294cd6eaafb263b544.jpg not downloaded yet
2026-03-28 21:07:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d0927b4-7821-576d-b810-13f892e61ee7 with identifier: UK60459
2026-03-28 21:07:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d0927b4-7821-576d-b810-13f892e61ee7 with scrape type 1
2026-03-28 21:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 2d0927b4-7821-576d-b810-13f892e61ee7
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F36%252F4e3651580068bfdb7675fb4f1feb60ac%252Fpa%252FUK60459_0a97f0dacff32eac9e675aa53ba2171c.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/36/4e3651580068bfdb7675fb4f1feb60ac/pa/UK60459_0a97f0dacff32eac9e675aa53ba2171c.jpg already downloaded
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F36%252F4e3651580068bfdb7675fb4f1feb60ac%252Fpa%252FUK60459_45f8f7abfe79d3d4585f76ef64427154.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/36/4e3651580068bfdb7675fb4f1feb60ac/pa/UK60459_45f8f7abfe79d3d4585f76ef64427154.jpg already downloaded
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F36%252F4e3651580068bfdb7675fb4f1feb60ac%252Fpa%252FUK60459_506b765d29a1db5927fb603a1ef85991.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/36/4e3651580068bfdb7675fb4f1feb60ac/pa/UK60459_506b765d29a1db5927fb603a1ef85991.jpg already downloaded
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F36%252F4e3651580068bfdb7675fb4f1feb60ac%252Fpa%252FUK60459_df4338045fe572ca0afe71e7ce1ca3ce.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/36/4e3651580068bfdb7675fb4f1feb60ac/pa/UK60459_df4338045fe572ca0afe71e7ce1ca3ce.jpg already downloaded
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252F36%252F4e3651580068bfdb7675fb4f1feb60ac%252Fpa%252FUK60459_aa6141380e2b3d59695965074162124a.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/36/4e3651580068bfdb7675fb4f1feb60ac/pa/UK60459_aa6141380e2b3d59695965074162124a.jpg already downloaded
2026-03-28 21:07:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2d0927b4-7821-576d-b810-13f892e61ee7, identifier: UK60459
2026-03-28 21:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_3b0f16923dd705d4a1bb19309ac2bbd0.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_7fc803ebbe8b06231929818ae1641b74.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2d0927b4-7821-576d-b810-13f892e61ee7 with identifier: UK60459
2026-03-28 21:07:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2d0927b4-7821-576d-b810-13f892e61ee7 with identifier: UK60459
2026-03-28 21:07:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2d0927b4-7821-576d-b810-13f892e61ee7 with identifier: UK60459 to the API
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UK60459>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.2L',
'engine_horse_power': 45,
'expiration_date': '2026-03-30T15:33:39Z',
'fuel_type': 'petrol',
'id': '2d0927b4-7821-576d-b810-13f892e61ee7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK60459',
'listing': 'auction',
'location': 'IT, Surbo',
'make': 'Opel',
'model': 'Corsa',
'odometer': 74879,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/img4e/36/4e3651580068bfdb7675fb4f1feb60ac/pa/UK60459_0a97f0dacff32eac9e675aa53ba2171c.jpg',
'https://img-pa.auto1.com/img4e/36/4e3651580068bfdb7675fb4f1feb60ac/pa/UK60459_45f8f7abfe79d3d4585f76ef64427154.jpg',
'https://img-pa.auto1.com/img4e/36/4e3651580068bfdb7675fb4f1feb60ac/pa/UK60459_506b765d29a1db5927fb603a1ef85991.jpg',
'https://img-pa.auto1.com/img4e/36/4e3651580068bfdb7675fb4f1feb60ac/pa/UK60459_df4338045fe572ca0afe71e7ce1ca3ce.jpg',
'https://img-pa.auto1.com/img4e/36/4e3651580068bfdb7675fb4f1feb60ac/pa/UK60459_aa6141380e2b3d59695965074162124a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0927b4-7821-576d-b810-13f892e61ee7/2d0927b4-7821-576d-b810-13f892e61ee7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104387,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/36/4e3651580068bfdb7675fb4f1feb60ac/pa/UK60459_0a97f0dacff32eac9e675aa53ba2171c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0927b4-7821-576d-b810-13f892e61ee7/2d0927b4-7821-576d-b810-13f892e61ee7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96375,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/36/4e3651580068bfdb7675fb4f1feb60ac/pa/UK60459_45f8f7abfe79d3d4585f76ef64427154.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0927b4-7821-576d-b810-13f892e61ee7/2d0927b4-7821-576d-b810-13f892e61ee7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76364,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/36/4e3651580068bfdb7675fb4f1feb60ac/pa/UK60459_506b765d29a1db5927fb603a1ef85991.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0927b4-7821-576d-b810-13f892e61ee7/2d0927b4-7821-576d-b810-13f892e61ee7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78451,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/36/4e3651580068bfdb7675fb4f1feb60ac/pa/UK60459_df4338045fe572ca0afe71e7ce1ca3ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0927b4-7821-576d-b810-13f892e61ee7/2d0927b4-7821-576d-b810-13f892e61ee7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77373,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/36/4e3651580068bfdb7675fb4f1feb60ac/pa/UK60459_aa6141380e2b3d59695965074162124a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '1995-05-16',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Corsa 1.2 City',
'transmission': 'manual',
'trim': 'City',
'year': 1995}
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UK60459%27 HTTP/1.1" 200 None
2026-03-28 21:07:47 [auto1.it] INFO: Saving data for UK60459: {'created_time': 1774732067.830681, 'last_price_update_time': 1774732067.830694, 'auction_closing_time': 1774884819.0}
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UK60459') HTTP/1.1" 204 0
2026-03-28 21:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_44aac1c4c3a45ef9168d07e7d783c6fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_80a75a5fbbdca1ab30ce1c7e16c1bf09.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F90%252Fa9909a0300bce01faae40b5855ada059%252Fpa%252FCY56164_e990ba774f95e477dfce1b674481ee50.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_e990ba774f95e477dfce1b674481ee50.jpg not downloaded yet
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fed%252F33ed45d00c07235904ef33e641f93af2%252Fpa%252FRS27725_12c3fddb72cb34c92104ae9329d28176.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_12c3fddb72cb34c92104ae9329d28176.jpg not downloaded yet
2026-03-28 21:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F90%252Fa9909a0300bce01faae40b5855ada059%252Fpa%252FCY56164_765438eb88e95965ec8374dfab616d29.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_765438eb88e95965ec8374dfab616d29.jpg not downloaded yet
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fed%252F33ed45d00c07235904ef33e641f93af2%252Fpa%252FRS27725_b6f75b5d1200f207ff908461ad60b337.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_b6f75b5d1200f207ff908461ad60b337.jpg not downloaded yet
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84197cd0>
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0501cad-3902-50d7-965a-215a7e41e9f2/f0501cad-3902-50d7-965a-215a7e41e9f2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F7b%252F497b3713317451f19a61afb2eabcc56d%252Fpa%252FNC22560_1e04e451afb7cb9f5c7e2c7f6ac69317.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_1e04e451afb7cb9f5c7e2c7f6ac69317.jpg saved to cache
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f0501cad-3902-50d7-965a-215a7e41e9f2
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84289ed0>
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0501cad-3902-50d7-965a-215a7e41e9f2/f0501cad-3902-50d7-965a-215a7e41e9f2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F7b%252F497b3713317451f19a61afb2eabcc56d%252Fpa%252FNC22560_3b0f16923dd705d4a1bb19309ac2bbd0.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_3b0f16923dd705d4a1bb19309ac2bbd0.jpg saved to cache
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f0501cad-3902-50d7-965a-215a7e41e9f2
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b85bb48d0>
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0501cad-3902-50d7-965a-215a7e41e9f2/f0501cad-3902-50d7-965a-215a7e41e9f2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F7b%252F497b3713317451f19a61afb2eabcc56d%252Fpa%252FNC22560_7fc803ebbe8b06231929818ae1641b74.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_7fc803ebbe8b06231929818ae1641b74.jpg saved to cache
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f0501cad-3902-50d7-965a-215a7e41e9f2
2026-03-28 21:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_062a7f20ef3114294cd6eaafb263b544.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_b01dde6955815c690ea4f304881e8ac9.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F90%252Fa9909a0300bce01faae40b5855ada059%252Fpa%252FCY56164_24e7c40c400a576c6b57e6e36880058a.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_24e7c40c400a576c6b57e6e36880058a.jpg not downloaded yet
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fed%252F33ed45d00c07235904ef33e641f93af2%252Fpa%252FRS27725_b8486cd9df52edfe9b703be5e08bea2f.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_b8486cd9df52edfe9b703be5e08bea2f.jpg not downloaded yet
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8428be50>
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0501cad-3902-50d7-965a-215a7e41e9f2/f0501cad-3902-50d7-965a-215a7e41e9f2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F7b%252F497b3713317451f19a61afb2eabcc56d%252Fpa%252FNC22560_44aac1c4c3a45ef9168d07e7d783c6fe.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_44aac1c4c3a45ef9168d07e7d783c6fe.jpg saved to cache
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f0501cad-3902-50d7-965a-215a7e41e9f2
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b841fc6d0>
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0501cad-3902-50d7-965a-215a7e41e9f2/f0501cad-3902-50d7-965a-215a7e41e9f2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F7b%252F497b3713317451f19a61afb2eabcc56d%252Fpa%252FNC22560_80a75a5fbbdca1ab30ce1c7e16c1bf09.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_80a75a5fbbdca1ab30ce1c7e16c1bf09.jpg saved to cache
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f0501cad-3902-50d7-965a-215a7e41e9f2
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F90%252Fa9909a0300bce01faae40b5855ada059%252Fpa%252FCY56164_0fb87e1320274f9984c3e20dea2ac733.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_0fb87e1320274f9984c3e20dea2ac733.jpg not downloaded yet
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fed%252F33ed45d00c07235904ef33e641f93af2%252Fpa%252FRS27725_0c33fc6825c8d93fd718b15e663e9aa4.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_0c33fc6825c8d93fd718b15e663e9aa4.jpg not downloaded yet
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F90%252Fa9909a0300bce01faae40b5855ada059%252Fpa%252FCY56164_0f8b7ae7768613cc3d8b62c0ef708216.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_0f8b7ae7768613cc3d8b62c0ef708216.jpg not downloaded yet
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fed%252F33ed45d00c07235904ef33e641f93af2%252Fpa%252FRS27725_1bf6a978dde651c2c11c6c11c2f9a3f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_1bf6a978dde651c2c11c6c11c2f9a3f8.jpg not downloaded yet
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fed%252F33ed45d00c07235904ef33e641f93af2%252Fpa%252FRS27725_f0c68fc530f47a495d4ef6ec5ff9ef66.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_f0c68fc530f47a495d4ef6ec5ff9ef66.jpg not downloaded yet
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8412e350>
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_537ae8d4-ddab-56b4-a650-f2573e594a02/537ae8d4-ddab-56b4-a650-f2573e594a02_image_0.jpg HTTP/1.1" 201 0
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fed%252F33ed45d00c07235904ef33e641f93af2%252Fpa%252FRS27725_062a7f20ef3114294cd6eaafb263b544.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_062a7f20ef3114294cd6eaafb263b544.jpg saved to cache
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 537ae8d4-ddab-56b4-a650-f2573e594a02
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b85be2810>
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0501cad-3902-50d7-965a-215a7e41e9f2/f0501cad-3902-50d7-965a-215a7e41e9f2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F7b%252F497b3713317451f19a61afb2eabcc56d%252Fpa%252FNC22560_b01dde6955815c690ea4f304881e8ac9.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_b01dde6955815c690ea4f304881e8ac9.jpg saved to cache
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f0501cad-3902-50d7-965a-215a7e41e9f2
2026-03-28 21:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_12c3fddb72cb34c92104ae9329d28176.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fed%252F33ed45d00c07235904ef33e641f93af2%252Fpa%252FRS27725_765aced512ae802cf8deb6cd504b7201.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_765aced512ae802cf8deb6cd504b7201.jpg not downloaded yet
2026-03-28 21:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_b6f75b5d1200f207ff908461ad60b337.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fed%252F33ed45d00c07235904ef33e641f93af2%252Fpa%252FRS27725_5a3da681f437e5e056a36ace1e2ddaa0.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_5a3da681f437e5e056a36ace1e2ddaa0.jpg not downloaded yet
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fed%252F33ed45d00c07235904ef33e641f93af2%252Fpa%252FRS27725_ed4f47eb18dd556cb1215c4e8e2faebe.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_ed4f47eb18dd556cb1215c4e8e2faebe.jpg not downloaded yet
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84144d50>
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_537ae8d4-ddab-56b4-a650-f2573e594a02/537ae8d4-ddab-56b4-a650-f2573e594a02_image_1.jpg HTTP/1.1" 201 0
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fed%252F33ed45d00c07235904ef33e641f93af2%252Fpa%252FRS27725_12c3fddb72cb34c92104ae9329d28176.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_12c3fddb72cb34c92104ae9329d28176.jpg saved to cache
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 537ae8d4-ddab-56b4-a650-f2573e594a02
2026-03-28 21:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_02cf2003a13e33023733eb6f51a2a0cb.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b85be1910>
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_537ae8d4-ddab-56b4-a650-f2573e594a02/537ae8d4-ddab-56b4-a650-f2573e594a02_image_2.jpg HTTP/1.1" 201 0
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fed%252F33ed45d00c07235904ef33e641f93af2%252Fpa%252FRS27725_b6f75b5d1200f207ff908461ad60b337.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_b6f75b5d1200f207ff908461ad60b337.jpg saved to cache
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 537ae8d4-ddab-56b4-a650-f2573e594a02
2026-03-28 21:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_f266668d4535b502d39815f1cab87878.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_f0c68fc530f47a495d4ef6ec5ff9ef66.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_1bf6a978dde651c2c11c6c11c2f9a3f8.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84206d50>
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81530959-605c-535f-b6f7-1f7bdfec6fc4/81530959-605c-535f-b6f7-1f7bdfec6fc4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F90%252Fa9909a0300bce01faae40b5855ada059%252Fpa%252FCY56164_02cf2003a13e33023733eb6f51a2a0cb.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_02cf2003a13e33023733eb6f51a2a0cb.jpg saved to cache
2026-03-28 21:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 81530959-605c-535f-b6f7-1f7bdfec6fc4
2026-03-28 21:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_ed4f47eb18dd556cb1215c4e8e2faebe.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ML45383> (referer: https://www.auto1.com/v1/car-details-view/ML45383/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TT70902/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AW19697> (referer: https://www.auto1.com/v1/car-details-view/AW19697/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HY50986/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EN63218/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b85be1e90>
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81530959-605c-535f-b6f7-1f7bdfec6fc4/81530959-605c-535f-b6f7-1f7bdfec6fc4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F90%252Fa9909a0300bce01faae40b5855ada059%252Fpa%252FCY56164_f266668d4535b502d39815f1cab87878.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_f266668d4535b502d39815f1cab87878.jpg saved to cache
2026-03-28 21:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 81530959-605c-535f-b6f7-1f7bdfec6fc4
2026-03-28 21:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b842ae590>
2026-03-28 21:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_537ae8d4-ddab-56b4-a650-f2573e594a02/537ae8d4-ddab-56b4-a650-f2573e594a02_image_6.jpg HTTP/1.1" 201 0
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fed%252F33ed45d00c07235904ef33e641f93af2%252Fpa%252FRS27725_f0c68fc530f47a495d4ef6ec5ff9ef66.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_f0c68fc530f47a495d4ef6ec5ff9ef66.jpg saved to cache
2026-03-28 21:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 537ae8d4-ddab-56b4-a650-f2573e594a02
2026-03-28 21:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84142490>
2026-03-28 21:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_537ae8d4-ddab-56b4-a650-f2573e594a02/537ae8d4-ddab-56b4-a650-f2573e594a02_image_5.jpg HTTP/1.1" 201 0
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fed%252F33ed45d00c07235904ef33e641f93af2%252Fpa%252FRS27725_1bf6a978dde651c2c11c6c11c2f9a3f8.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_1bf6a978dde651c2c11c6c11c2f9a3f8.jpg saved to cache
2026-03-28 21:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 537ae8d4-ddab-56b4-a650-f2573e594a02
2026-03-28 21:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PV47203/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7ee1c610>
2026-03-28 21:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_537ae8d4-ddab-56b4-a650-f2573e594a02/537ae8d4-ddab-56b4-a650-f2573e594a02_image_9.jpg HTTP/1.1" 201 0
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fed%252F33ed45d00c07235904ef33e641f93af2%252Fpa%252FRS27725_ed4f47eb18dd556cb1215c4e8e2faebe.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_ed4f47eb18dd556cb1215c4e8e2faebe.jpg saved to cache
2026-03-28 21:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 537ae8d4-ddab-56b4-a650-f2573e594a02
2026-03-28 21:07:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b75765e3-e11c-54eb-a6c1-3af70b5a6f2b with identifier: ML45383
2026-03-28 21:07:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b75765e3-e11c-54eb-a6c1-3af70b5a6f2b with scrape type 1
2026-03-28 21:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item b75765e3-e11c-54eb-a6c1-3af70b5a6f2b
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F15%252F4815207333d7e86fc276a05891c624e3%252Fpa%252FML45383_472a0fd620d5f8a1566539bd8cb99d75.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/15/4815207333d7e86fc276a05891c624e3/pa/ML45383_472a0fd620d5f8a1566539bd8cb99d75.jpg not downloaded yet
2026-03-28 21:07:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0580510c-e7ea-582c-b859-578d14812551 with identifier: AW19697
2026-03-28 21:07:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0580510c-e7ea-582c-b859-578d14812551 with scrape type 1
2026-03-28 21:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0580510c-e7ea-582c-b859-578d14812551
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F47%252F05477a038622a2089dd44853ce2d33f2%252Fpa%252FAW19697_de656baab516b943515fff1e663bba4d.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_de656baab516b943515fff1e663bba4d.jpg already downloaded
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F47%252F05477a038622a2089dd44853ce2d33f2%252Fpa%252FAW19697_1a50eff30828bc94bad1e4a1b49c9169.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_1a50eff30828bc94bad1e4a1b49c9169.jpg already downloaded
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F47%252F05477a038622a2089dd44853ce2d33f2%252Fpa%252FAW19697_7a8d61ffd88587d3209179896c27e13a.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_7a8d61ffd88587d3209179896c27e13a.jpg already downloaded
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F47%252F05477a038622a2089dd44853ce2d33f2%252Fpa%252FAW19697_c783cf1a0c30d5265e3b18e868d8cad1.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_c783cf1a0c30d5265e3b18e868d8cad1.jpg already downloaded
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F47%252F05477a038622a2089dd44853ce2d33f2%252Fpa%252FAW19697_77779b64b2342e6eae79c5f09b362fde.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_77779b64b2342e6eae79c5f09b362fde.jpg already downloaded
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F47%252F05477a038622a2089dd44853ce2d33f2%252Fpa%252FAW19697_9ec2944a35fa8d734010f16e9d8e8ff4.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_9ec2944a35fa8d734010f16e9d8e8ff4.jpg already downloaded
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F47%252F05477a038622a2089dd44853ce2d33f2%252Fpa%252FAW19697_82e1699fedeaeac271de41aa8f5d9c75.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_82e1699fedeaeac271de41aa8f5d9c75.jpg already downloaded
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F47%252F05477a038622a2089dd44853ce2d33f2%252Fpa%252FAW19697_aa688d9d818da7ee828d3c1fa38e97aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_aa688d9d818da7ee828d3c1fa38e97aa.jpg already downloaded
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F47%252F05477a038622a2089dd44853ce2d33f2%252Fpa%252FAW19697_8bf52d02787a7fb9c3f942a21f7967a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_8bf52d02787a7fb9c3f942a21f7967a2.jpg already downloaded
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F47%252F05477a038622a2089dd44853ce2d33f2%252Fpa%252FAW19697_542934e574c88ae461327588a4402df8.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_542934e574c88ae461327588a4402df8.jpg already downloaded
2026-03-28 21:07:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0580510c-e7ea-582c-b859-578d14812551, identifier: AW19697
2026-03-28 21:07:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0580510c-e7ea-582c-b859-578d14812551 with identifier: AW19697
2026-03-28 21:07:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0580510c-e7ea-582c-b859-578d14812551 with identifier: AW19697
2026-03-28 21:07:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0580510c-e7ea-582c-b859-578d14812551 with identifier: AW19697 to the API
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AW19697>
{'auction_title': '',
'c_o_2_emission_value': 179,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '3.0L',
'engine_horse_power': 250,
'expiration_date': '2026-03-30T15:26:24Z',
'fuel_type': 'diesel',
'id': '0580510c-e7ea-582c-b859-578d14812551',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW19697',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Porsche',
'model': 'Cayenne',
'odometer': 166916,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_de656baab516b943515fff1e663bba4d.jpg',
'https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_1a50eff30828bc94bad1e4a1b49c9169.jpg',
'https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_7a8d61ffd88587d3209179896c27e13a.jpg',
'https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_c783cf1a0c30d5265e3b18e868d8cad1.jpg',
'https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_77779b64b2342e6eae79c5f09b362fde.jpg',
'https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_9ec2944a35fa8d734010f16e9d8e8ff4.jpg',
'https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_82e1699fedeaeac271de41aa8f5d9c75.jpg',
'https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_aa688d9d818da7ee828d3c1fa38e97aa.jpg',
'https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_8bf52d02787a7fb9c3f942a21f7967a2.jpg',
'https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_542934e574c88ae461327588a4402df8.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0580510c-e7ea-582c-b859-578d14812551/0580510c-e7ea-582c-b859-578d14812551_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63917,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_de656baab516b943515fff1e663bba4d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0580510c-e7ea-582c-b859-578d14812551/0580510c-e7ea-582c-b859-578d14812551_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61429,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_1a50eff30828bc94bad1e4a1b49c9169.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0580510c-e7ea-582c-b859-578d14812551/0580510c-e7ea-582c-b859-578d14812551_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69000,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_7a8d61ffd88587d3209179896c27e13a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0580510c-e7ea-582c-b859-578d14812551/0580510c-e7ea-582c-b859-578d14812551_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53138,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_c783cf1a0c30d5265e3b18e868d8cad1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0580510c-e7ea-582c-b859-578d14812551/0580510c-e7ea-582c-b859-578d14812551_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68055,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_77779b64b2342e6eae79c5f09b362fde.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0580510c-e7ea-582c-b859-578d14812551/0580510c-e7ea-582c-b859-578d14812551_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72302,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_9ec2944a35fa8d734010f16e9d8e8ff4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0580510c-e7ea-582c-b859-578d14812551/0580510c-e7ea-582c-b859-578d14812551_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64990,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_82e1699fedeaeac271de41aa8f5d9c75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0580510c-e7ea-582c-b859-578d14812551/0580510c-e7ea-582c-b859-578d14812551_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64236,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_aa688d9d818da7ee828d3c1fa38e97aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0580510c-e7ea-582c-b859-578d14812551/0580510c-e7ea-582c-b859-578d14812551_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65132,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_8bf52d02787a7fb9c3f942a21f7967a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0580510c-e7ea-582c-b859-578d14812551/0580510c-e7ea-582c-b859-578d14812551_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82134,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/47/05477a038622a2089dd44853ce2d33f2/pa/AW19697_542934e574c88ae461327588a4402df8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-03-29',
'seats_number': 5,
'seller_name': None,
'title': 'Porsche Cayenne Diesel Platinum Edition',
'transmission': 'automatic',
'trim': 'Platinum Edition',
'year': 2017}
2026-03-28 21:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW19697%27 HTTP/1.1" 200 None
2026-03-28 21:07:50 [auto1.it] INFO: Saving data for AW19697: {'created_time': 1774732070.004756, 'last_price_update_time': 1774732070.004769, 'auction_closing_time': 1774884384.0}
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AW19697') HTTP/1.1" 204 0
2026-03-28 21:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_b8486cd9df52edfe9b703be5e08bea2f.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_5a3da681f437e5e056a36ace1e2ddaa0.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_765aced512ae802cf8deb6cd504b7201.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_0c33fc6825c8d93fd718b15e663e9aa4.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F15%252F4815207333d7e86fc276a05891c624e3%252Fpa%252FML45383_6b6bb1cde6572d0c58b3446e75136e29.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/15/4815207333d7e86fc276a05891c624e3/pa/ML45383_6b6bb1cde6572d0c58b3446e75136e29.jpg not downloaded yet
2026-03-28 21:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RN27083> (referer: https://www.auto1.com/v1/car-details-view/RN27083/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F15%252F4815207333d7e86fc276a05891c624e3%252Fpa%252FML45383_c21ce50126d4581601b0f340406eb899.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/15/4815207333d7e86fc276a05891c624e3/pa/ML45383_c21ce50126d4581601b0f340406eb899.jpg not downloaded yet
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F15%252F4815207333d7e86fc276a05891c624e3%252Fpa%252FML45383_c49ab33662fd93152c0a952b58573afc.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/15/4815207333d7e86fc276a05891c624e3/pa/ML45383_c49ab33662fd93152c0a952b58573afc.jpg not downloaded yet
2026-03-28 21:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_11af315dc2b5bce77fbc4d25dd9a209a.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F15%252F4815207333d7e86fc276a05891c624e3%252Fpa%252FML45383_d085ac5faf3c318978967e5d4edf151c.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/15/4815207333d7e86fc276a05891c624e3/pa/ML45383_d085ac5faf3c318978967e5d4edf151c.jpg not downloaded yet
2026-03-28 21:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8428d550>
2026-03-28 21:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_537ae8d4-ddab-56b4-a650-f2573e594a02/537ae8d4-ddab-56b4-a650-f2573e594a02_image_3.jpg HTTP/1.1" 201 0
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fed%252F33ed45d00c07235904ef33e641f93af2%252Fpa%252FRS27725_b8486cd9df52edfe9b703be5e08bea2f.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_b8486cd9df52edfe9b703be5e08bea2f.jpg saved to cache
2026-03-28 21:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 537ae8d4-ddab-56b4-a650-f2573e594a02
2026-03-28 21:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84196a90>
2026-03-28 21:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_537ae8d4-ddab-56b4-a650-f2573e594a02/537ae8d4-ddab-56b4-a650-f2573e594a02_image_8.jpg HTTP/1.1" 201 0
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fed%252F33ed45d00c07235904ef33e641f93af2%252Fpa%252FRS27725_5a3da681f437e5e056a36ace1e2ddaa0.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_5a3da681f437e5e056a36ace1e2ddaa0.jpg saved to cache
2026-03-28 21:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 537ae8d4-ddab-56b4-a650-f2573e594a02
2026-03-28 21:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7f7bddd0>
2026-03-28 21:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_537ae8d4-ddab-56b4-a650-f2573e594a02/537ae8d4-ddab-56b4-a650-f2573e594a02_image_7.jpg HTTP/1.1" 201 0
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fed%252F33ed45d00c07235904ef33e641f93af2%252Fpa%252FRS27725_765aced512ae802cf8deb6cd504b7201.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_765aced512ae802cf8deb6cd504b7201.jpg saved to cache
2026-03-28 21:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 537ae8d4-ddab-56b4-a650-f2573e594a02
2026-03-28 21:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b840fde50>
2026-03-28 21:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_537ae8d4-ddab-56b4-a650-f2573e594a02/537ae8d4-ddab-56b4-a650-f2573e594a02_image_4.jpg HTTP/1.1" 201 0
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252Fed%252F33ed45d00c07235904ef33e641f93af2%252Fpa%252FRS27725_0c33fc6825c8d93fd718b15e663e9aa4.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_0c33fc6825c8d93fd718b15e663e9aa4.jpg saved to cache
2026-03-28 21:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 537ae8d4-ddab-56b4-a650-f2573e594a02
2026-03-28 21:07:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 537ae8d4-ddab-56b4-a650-f2573e594a02, skipping ID generation
2026-03-28 21:07:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 537ae8d4-ddab-56b4-a650-f2573e594a02 with scrape type 1
2026-03-28 21:07:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 537ae8d4-ddab-56b4-a650-f2573e594a02 sending to next pipeline
2026-03-28 21:07:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 537ae8d4-ddab-56b4-a650-f2573e594a02, identifier: RS27725
2026-03-28 21:07:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 537ae8d4-ddab-56b4-a650-f2573e594a02 with identifier: RS27725
2026-03-28 21:07:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 537ae8d4-ddab-56b4-a650-f2573e594a02 with identifier: RS27725
2026-03-28 21:07:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 537ae8d4-ddab-56b4-a650-f2573e594a02 with identifier: RS27725 to the API
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_0c33fc6825c8d93fd718b15e663e9aa4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 94,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6B',
'engine': '1.0L',
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:42:05Z',
'fuel_type': 'petrol',
'id': '537ae8d4-ddab-56b4-a650-f2573e594a02',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS27725',
'listing': 'auction',
'location': 'IT, Roma RM',
'make': 'Smart',
'model': 'fortwo',
'odometer': 85120,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_537ae8d4-ddab-56b4-a650-f2573e594a02/537ae8d4-ddab-56b4-a650-f2573e594a02_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61918,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_062a7f20ef3114294cd6eaafb263b544.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_537ae8d4-ddab-56b4-a650-f2573e594a02/537ae8d4-ddab-56b4-a650-f2573e594a02_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66607,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_12c3fddb72cb34c92104ae9329d28176.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_537ae8d4-ddab-56b4-a650-f2573e594a02/537ae8d4-ddab-56b4-a650-f2573e594a02_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67212,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_b6f75b5d1200f207ff908461ad60b337.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_537ae8d4-ddab-56b4-a650-f2573e594a02/537ae8d4-ddab-56b4-a650-f2573e594a02_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60687,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_b8486cd9df52edfe9b703be5e08bea2f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_537ae8d4-ddab-56b4-a650-f2573e594a02/537ae8d4-ddab-56b4-a650-f2573e594a02_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57060,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_0c33fc6825c8d93fd718b15e663e9aa4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_537ae8d4-ddab-56b4-a650-f2573e594a02/537ae8d4-ddab-56b4-a650-f2573e594a02_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67355,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_1bf6a978dde651c2c11c6c11c2f9a3f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_537ae8d4-ddab-56b4-a650-f2573e594a02/537ae8d4-ddab-56b4-a650-f2573e594a02_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52797,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_f0c68fc530f47a495d4ef6ec5ff9ef66.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_537ae8d4-ddab-56b4-a650-f2573e594a02/537ae8d4-ddab-56b4-a650-f2573e594a02_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63494,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_765aced512ae802cf8deb6cd504b7201.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_537ae8d4-ddab-56b4-a650-f2573e594a02/537ae8d4-ddab-56b4-a650-f2573e594a02_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59145,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_5a3da681f437e5e056a36ace1e2ddaa0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_537ae8d4-ddab-56b4-a650-f2573e594a02/537ae8d4-ddab-56b4-a650-f2573e594a02_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80800,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/ed/33ed45d00c07235904ef33e641f93af2/pa/RS27725_ed4f47eb18dd556cb1215c4e8e2faebe.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-11-22',
'seats_number': 2,
'seller_name': None,
'title': 'Smart fortwo 1.0 Basis passion',
'transmission': 'automatic',
'trim': 'Basis passion',
'year': 2017}
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS27725%27 HTTP/1.1" 200 None
2026-03-28 21:07:50 [auto1.it] INFO: Saving data for RS27725: {'created_time': 1774732070.756031, 'last_price_update_time': 1774732070.756044, 'auction_closing_time': 1774885325.0}
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RS27725') HTTP/1.1" 204 0
2026-03-28 21:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/15/4815207333d7e86fc276a05891c624e3/pa/ML45383_472a0fd620d5f8a1566539bd8cb99d75.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_0141af47aa3bf121d1c23de24026a9ac.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/15/4815207333d7e86fc276a05891c624e3/pa/ML45383_6b6bb1cde6572d0c58b3446e75136e29.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c050adfd-2e5f-57fc-84b0-cfdc5d69333e with identifier: RN27083
2026-03-28 21:07:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c050adfd-2e5f-57fc-84b0-cfdc5d69333e with scrape type 1
2026-03-28 21:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c050adfd-2e5f-57fc-84b0-cfdc5d69333e
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F20%252Fb2201e7086e1733f795da7b4ad698431%252Fpa%252FRN27083_bb643b42a37589a23dc3fa09941ee594.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_bb643b42a37589a23dc3fa09941ee594.jpg not downloaded yet
2026-03-28 21:07:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 21:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8412cb90>
2026-03-28 21:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81530959-605c-535f-b6f7-1f7bdfec6fc4/81530959-605c-535f-b6f7-1f7bdfec6fc4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F90%252Fa9909a0300bce01faae40b5855ada059%252Fpa%252FCY56164_11af315dc2b5bce77fbc4d25dd9a209a.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_11af315dc2b5bce77fbc4d25dd9a209a.jpg saved to cache
2026-03-28 21:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 81530959-605c-535f-b6f7-1f7bdfec6fc4
2026-03-28 21:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/15/4815207333d7e86fc276a05891c624e3/pa/ML45383_c49ab33662fd93152c0a952b58573afc.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F20%252Fb2201e7086e1733f795da7b4ad698431%252Fpa%252FRN27083_0290400b3f6f181a3e3f2c915d651642.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_0290400b3f6f181a3e3f2c915d651642.jpg not downloaded yet
2026-03-28 21:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MD59623> (referer: https://www.auto1.com/v1/car-details-view/MD59623/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XP44684> (referer: https://www.auto1.com/v1/car-details-view/XP44684/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YX84472> (referer: https://www.auto1.com/v1/car-details-view/YX84472/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7ee30e50>
2026-03-28 21:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75765e3-e11c-54eb-a6c1-3af70b5a6f2b/b75765e3-e11c-54eb-a6c1-3af70b5a6f2b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F15%252F4815207333d7e86fc276a05891c624e3%252Fpa%252FML45383_472a0fd620d5f8a1566539bd8cb99d75.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/15/4815207333d7e86fc276a05891c624e3/pa/ML45383_472a0fd620d5f8a1566539bd8cb99d75.jpg saved to cache
2026-03-28 21:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b75765e3-e11c-54eb-a6c1-3af70b5a6f2b
2026-03-28 21:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84191b90>
2026-03-28 21:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0501cad-3902-50d7-965a-215a7e41e9f2/f0501cad-3902-50d7-965a-215a7e41e9f2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F7b%252F497b3713317451f19a61afb2eabcc56d%252Fpa%252FNC22560_0141af47aa3bf121d1c23de24026a9ac.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_0141af47aa3bf121d1c23de24026a9ac.jpg saved to cache
2026-03-28 21:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f0501cad-3902-50d7-965a-215a7e41e9f2
2026-03-28 21:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7f733f90>
2026-03-28 21:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75765e3-e11c-54eb-a6c1-3af70b5a6f2b/b75765e3-e11c-54eb-a6c1-3af70b5a6f2b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F15%252F4815207333d7e86fc276a05891c624e3%252Fpa%252FML45383_6b6bb1cde6572d0c58b3446e75136e29.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/15/4815207333d7e86fc276a05891c624e3/pa/ML45383_6b6bb1cde6572d0c58b3446e75136e29.jpg saved to cache
2026-03-28 21:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b75765e3-e11c-54eb-a6c1-3af70b5a6f2b
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F20%252Fb2201e7086e1733f795da7b4ad698431%252Fpa%252FRN27083_3fdfce0a0179bf5fb623d1c3f9764d85.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_3fdfce0a0179bf5fb623d1c3f9764d85.jpg not downloaded yet
2026-03-28 21:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/15/4815207333d7e86fc276a05891c624e3/pa/ML45383_d085ac5faf3c318978967e5d4edf151c.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/15/4815207333d7e86fc276a05891c624e3/pa/ML45383_c21ce50126d4581601b0f340406eb899.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F20%252Fb2201e7086e1733f795da7b4ad698431%252Fpa%252FRN27083_0271cc641920223dff1a18f5a4fc151d.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_0271cc641920223dff1a18f5a4fc151d.jpg not downloaded yet
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F20%252Fb2201e7086e1733f795da7b4ad698431%252Fpa%252FRN27083_2753f70f2747d81e3f991cb664477c1c.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_2753f70f2747d81e3f991cb664477c1c.jpg not downloaded yet
2026-03-28 21:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7f7b9a50>
2026-03-28 21:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75765e3-e11c-54eb-a6c1-3af70b5a6f2b/b75765e3-e11c-54eb-a6c1-3af70b5a6f2b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F15%252F4815207333d7e86fc276a05891c624e3%252Fpa%252FML45383_c49ab33662fd93152c0a952b58573afc.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/15/4815207333d7e86fc276a05891c624e3/pa/ML45383_c49ab33662fd93152c0a952b58573afc.jpg saved to cache
2026-03-28 21:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b75765e3-e11c-54eb-a6c1-3af70b5a6f2b
2026-03-28 21:07:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 343711fd-47d9-55e3-aa94-8388493d6c8d with identifier: MD59623
2026-03-28 21:07:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 343711fd-47d9-55e3-aa94-8388493d6c8d with scrape type 1
2026-03-28 21:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 343711fd-47d9-55e3-aa94-8388493d6c8d
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fad%252Fb2adca6f6f31ac63ee397871b03ac998%252Fpa%252FMD59623_d8298e7ec81692a66be240fe0ad1d528.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_d8298e7ec81692a66be240fe0ad1d528.jpg already downloaded
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fad%252Fb2adca6f6f31ac63ee397871b03ac998%252Fpa%252FMD59623_4e92daad25396f86a9cfbeed1ef679ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_4e92daad25396f86a9cfbeed1ef679ea.jpg already downloaded
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fad%252Fb2adca6f6f31ac63ee397871b03ac998%252Fpa%252FMD59623_2bc6db6a3ba6a294b88279f479b4657d.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_2bc6db6a3ba6a294b88279f479b4657d.jpg already downloaded
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fad%252Fb2adca6f6f31ac63ee397871b03ac998%252Fpa%252FMD59623_12675b39ea1c7aebcb77b4bbe0f24b8a.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_12675b39ea1c7aebcb77b4bbe0f24b8a.jpg already downloaded
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fad%252Fb2adca6f6f31ac63ee397871b03ac998%252Fpa%252FMD59623_2277ffe53a743d0b322ba97eb30161b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_2277ffe53a743d0b322ba97eb30161b3.jpg already downloaded
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fad%252Fb2adca6f6f31ac63ee397871b03ac998%252Fpa%252FMD59623_4253e20c32a5ad76d3699510054f5834.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_4253e20c32a5ad76d3699510054f5834.jpg already downloaded
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fad%252Fb2adca6f6f31ac63ee397871b03ac998%252Fpa%252FMD59623_c7f251cb4936618d90047e14a64aac0c.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_c7f251cb4936618d90047e14a64aac0c.jpg already downloaded
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fad%252Fb2adca6f6f31ac63ee397871b03ac998%252Fpa%252FMD59623_60424288f8370062d3d5a89e4caccffa.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_60424288f8370062d3d5a89e4caccffa.jpg already downloaded
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fad%252Fb2adca6f6f31ac63ee397871b03ac998%252Fpa%252FMD59623_905bcad5830511de6f61d6755adf2eac.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_905bcad5830511de6f61d6755adf2eac.jpg already downloaded
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fad%252Fb2adca6f6f31ac63ee397871b03ac998%252Fpa%252FMD59623_b0f0e0d22e8f0fd42e31c819aecfce07.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_b0f0e0d22e8f0fd42e31c819aecfce07.jpg already downloaded
2026-03-28 21:07:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 343711fd-47d9-55e3-aa94-8388493d6c8d, identifier: MD59623
2026-03-28 21:07:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 635da28b-5aac-5a71-be90-9c51a7875148 with identifier: XP44684
2026-03-28 21:07:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 635da28b-5aac-5a71-be90-9c51a7875148 with scrape type 1
2026-03-28 21:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 635da28b-5aac-5a71-be90-9c51a7875148
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5c%252F8b5cdf0982d8bd309ac826979d4d9f51%252Fpa%252FXP44684_4ab80f427eee70f7e747589566aa45bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_4ab80f427eee70f7e747589566aa45bc.jpg not downloaded yet
2026-03-28 21:07:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bc4af0b-876b-5cba-9ed6-488e968d3fa6 with identifier: YX84472
2026-03-28 21:07:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bc4af0b-876b-5cba-9ed6-488e968d3fa6 with scrape type 1
2026-03-28 21:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9bc4af0b-876b-5cba-9ed6-488e968d3fa6
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe8%252Fdee8342751f21c9bf5748e438fa52004%252Fpa%252FYX84472_a5683c43584a9e8972431898d38b5b5d.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_a5683c43584a9e8972431898d38b5b5d.jpg not downloaded yet
2026-03-28 21:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_bb643b42a37589a23dc3fa09941ee594.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 343711fd-47d9-55e3-aa94-8388493d6c8d with identifier: MD59623
2026-03-28 21:07:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 343711fd-47d9-55e3-aa94-8388493d6c8d with identifier: MD59623
2026-03-28 21:07:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 343711fd-47d9-55e3-aa94-8388493d6c8d with identifier: MD59623 to the API
2026-03-28 21:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MD59623>
{'auction_title': '',
'c_o_2_emission_value': 199,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '3.0L',
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:40:17Z',
'fuel_type': 'diesel',
'id': '343711fd-47d9-55e3-aa94-8388493d6c8d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD59623',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Audi',
'model': 'Q5',
'odometer': 363384,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_d8298e7ec81692a66be240fe0ad1d528.jpg',
'https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_4e92daad25396f86a9cfbeed1ef679ea.jpg',
'https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_2bc6db6a3ba6a294b88279f479b4657d.jpg',
'https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_12675b39ea1c7aebcb77b4bbe0f24b8a.jpg',
'https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_2277ffe53a743d0b322ba97eb30161b3.jpg',
'https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_4253e20c32a5ad76d3699510054f5834.jpg',
'https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_c7f251cb4936618d90047e14a64aac0c.jpg',
'https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_60424288f8370062d3d5a89e4caccffa.jpg',
'https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_905bcad5830511de6f61d6755adf2eac.jpg',
'https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_b0f0e0d22e8f0fd42e31c819aecfce07.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343711fd-47d9-55e3-aa94-8388493d6c8d/343711fd-47d9-55e3-aa94-8388493d6c8d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56516,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_d8298e7ec81692a66be240fe0ad1d528.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343711fd-47d9-55e3-aa94-8388493d6c8d/343711fd-47d9-55e3-aa94-8388493d6c8d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54585,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_4e92daad25396f86a9cfbeed1ef679ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343711fd-47d9-55e3-aa94-8388493d6c8d/343711fd-47d9-55e3-aa94-8388493d6c8d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52825,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_2bc6db6a3ba6a294b88279f479b4657d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343711fd-47d9-55e3-aa94-8388493d6c8d/343711fd-47d9-55e3-aa94-8388493d6c8d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41451,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_12675b39ea1c7aebcb77b4bbe0f24b8a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343711fd-47d9-55e3-aa94-8388493d6c8d/343711fd-47d9-55e3-aa94-8388493d6c8d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44289,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_2277ffe53a743d0b322ba97eb30161b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343711fd-47d9-55e3-aa94-8388493d6c8d/343711fd-47d9-55e3-aa94-8388493d6c8d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51643,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_4253e20c32a5ad76d3699510054f5834.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343711fd-47d9-55e3-aa94-8388493d6c8d/343711fd-47d9-55e3-aa94-8388493d6c8d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37156,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_c7f251cb4936618d90047e14a64aac0c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343711fd-47d9-55e3-aa94-8388493d6c8d/343711fd-47d9-55e3-aa94-8388493d6c8d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59881,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_60424288f8370062d3d5a89e4caccffa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343711fd-47d9-55e3-aa94-8388493d6c8d/343711fd-47d9-55e3-aa94-8388493d6c8d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59099,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_905bcad5830511de6f61d6755adf2eac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_343711fd-47d9-55e3-aa94-8388493d6c8d/343711fd-47d9-55e3-aa94-8388493d6c8d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33952,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/ad/b2adca6f6f31ac63ee397871b03ac998/pa/MD59623_b0f0e0d22e8f0fd42e31c819aecfce07.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-04-25',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q5 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2010}
2026-03-28 21:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MD59623%27 HTTP/1.1" 200 None
2026-03-28 21:07:52 [auto1.it] INFO: Saving data for MD59623: {'created_time': 1774732072.827133, 'last_price_update_time': 1774732072.827145, 'auction_closing_time': 1774885217.0}
2026-03-28 21:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MD59623') HTTP/1.1" 204 0
2026-03-28 21:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F20%252Fb2201e7086e1733f795da7b4ad698431%252Fpa%252FRN27083_992a3715f8873c4973b4ec6d9da7d095.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_992a3715f8873c4973b4ec6d9da7d095.jpg not downloaded yet
2026-03-28 21:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5c%252F8b5cdf0982d8bd309ac826979d4d9f51%252Fpa%252FXP44684_7dfaeebf58682ca3efff52724807c9d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_7dfaeebf58682ca3efff52724807c9d3.jpg not downloaded yet
2026-03-28 21:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe8%252Fdee8342751f21c9bf5748e438fa52004%252Fpa%252FYX84472_3606238e001e986491ea10180ed6f724.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_3606238e001e986491ea10180ed6f724.jpg not downloaded yet
2026-03-28 21:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_0290400b3f6f181a3e3f2c915d651642.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PV47203> (referer: https://www.auto1.com/v1/car-details-view/PV47203/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F20%252Fb2201e7086e1733f795da7b4ad698431%252Fpa%252FRN27083_1696a5243c497ec8a0018ed0fe15042b.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_1696a5243c497ec8a0018ed0fe15042b.jpg not downloaded yet
2026-03-28 21:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5c%252F8b5cdf0982d8bd309ac826979d4d9f51%252Fpa%252FXP44684_c5c8819c9cbf4ab4a3936a6d60b65033.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_c5c8819c9cbf4ab4a3936a6d60b65033.jpg not downloaded yet
2026-03-28 21:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe8%252Fdee8342751f21c9bf5748e438fa52004%252Fpa%252FYX84472_6b1c9065b15ad392ac97d173b5bd1baf.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_6b1c9065b15ad392ac97d173b5bd1baf.jpg not downloaded yet
2026-03-28 21:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TT70902> (referer: https://www.auto1.com/v1/car-details-view/TT70902/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HY50986> (referer: https://www.auto1.com/v1/car-details-view/HY50986/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EN63218> (referer: https://www.auto1.com/v1/car-details-view/EN63218/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b842b6a50>
2026-03-28 21:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75765e3-e11c-54eb-a6c1-3af70b5a6f2b/b75765e3-e11c-54eb-a6c1-3af70b5a6f2b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F15%252F4815207333d7e86fc276a05891c624e3%252Fpa%252FML45383_d085ac5faf3c318978967e5d4edf151c.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/15/4815207333d7e86fc276a05891c624e3/pa/ML45383_d085ac5faf3c318978967e5d4edf151c.jpg saved to cache
2026-03-28 21:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b75765e3-e11c-54eb-a6c1-3af70b5a6f2b
2026-03-28 21:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7ee2f410>
2026-03-28 21:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b75765e3-e11c-54eb-a6c1-3af70b5a6f2b/b75765e3-e11c-54eb-a6c1-3af70b5a6f2b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F15%252F4815207333d7e86fc276a05891c624e3%252Fpa%252FML45383_c21ce50126d4581601b0f340406eb899.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/15/4815207333d7e86fc276a05891c624e3/pa/ML45383_c21ce50126d4581601b0f340406eb899.jpg saved to cache
2026-03-28 21:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b75765e3-e11c-54eb-a6c1-3af70b5a6f2b
2026-03-28 21:07:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b75765e3-e11c-54eb-a6c1-3af70b5a6f2b, skipping ID generation
2026-03-28 21:07:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b75765e3-e11c-54eb-a6c1-3af70b5a6f2b with scrape type 1
2026-03-28 21:07:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b75765e3-e11c-54eb-a6c1-3af70b5a6f2b sending to next pipeline
2026-03-28 21:07:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b75765e3-e11c-54eb-a6c1-3af70b5a6f2b, identifier: ML45383
2026-03-28 21:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b85bdeb50>
2026-03-28 21:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c050adfd-2e5f-57fc-84b0-cfdc5d69333e/c050adfd-2e5f-57fc-84b0-cfdc5d69333e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F20%252Fb2201e7086e1733f795da7b4ad698431%252Fpa%252FRN27083_bb643b42a37589a23dc3fa09941ee594.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_bb643b42a37589a23dc3fa09941ee594.jpg saved to cache
2026-03-28 21:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c050adfd-2e5f-57fc-84b0-cfdc5d69333e
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F20%252Fb2201e7086e1733f795da7b4ad698431%252Fpa%252FRN27083_f01512169205e216a7c307f5f564f08c.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_f01512169205e216a7c307f5f564f08c.jpg not downloaded yet
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5c%252F8b5cdf0982d8bd309ac826979d4d9f51%252Fpa%252FXP44684_d27521567566c9b48c21be9daaffb234.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_d27521567566c9b48c21be9daaffb234.jpg not downloaded yet
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe8%252Fdee8342751f21c9bf5748e438fa52004%252Fpa%252FYX84472_506bb2751287c22a67e4cb871eed65f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_506bb2751287c22a67e4cb871eed65f7.jpg not downloaded yet
2026-03-28 21:07:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b75765e3-e11c-54eb-a6c1-3af70b5a6f2b with identifier: ML45383
2026-03-28 21:07:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b75765e3-e11c-54eb-a6c1-3af70b5a6f2b with identifier: ML45383
2026-03-28 21:07:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b75765e3-e11c-54eb-a6c1-3af70b5a6f2b with identifier: ML45383 to the API
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img48/15/4815207333d7e86fc276a05891c624e3/pa/ML45383_c21ce50126d4581601b0f340406eb899.jpg>
{'auction_title': '',
'c_o_2_emission_value': 262,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 3',
'engine': '2.8L',
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:50:33Z',
'fuel_type': 'diesel',
'id': 'b75765e3-e11c-54eb-a6c1-3af70b5a6f2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML45383',
'listing': 'auction',
'location': 'IT, Pavia',
'make': 'Jeep',
'model': 'Cherokee',
'odometer': 249487,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75765e3-e11c-54eb-a6c1-3af70b5a6f2b/b75765e3-e11c-54eb-a6c1-3af70b5a6f2b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69776,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/15/4815207333d7e86fc276a05891c624e3/pa/ML45383_472a0fd620d5f8a1566539bd8cb99d75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75765e3-e11c-54eb-a6c1-3af70b5a6f2b/b75765e3-e11c-54eb-a6c1-3af70b5a6f2b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67773,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/15/4815207333d7e86fc276a05891c624e3/pa/ML45383_6b6bb1cde6572d0c58b3446e75136e29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75765e3-e11c-54eb-a6c1-3af70b5a6f2b/b75765e3-e11c-54eb-a6c1-3af70b5a6f2b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68316,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/15/4815207333d7e86fc276a05891c624e3/pa/ML45383_c21ce50126d4581601b0f340406eb899.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75765e3-e11c-54eb-a6c1-3af70b5a6f2b/b75765e3-e11c-54eb-a6c1-3af70b5a6f2b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53396,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/15/4815207333d7e86fc276a05891c624e3/pa/ML45383_c49ab33662fd93152c0a952b58573afc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b75765e3-e11c-54eb-a6c1-3af70b5a6f2b/b75765e3-e11c-54eb-a6c1-3af70b5a6f2b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40715,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/15/4815207333d7e86fc276a05891c624e3/pa/ML45383_d085ac5faf3c318978967e5d4edf151c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-04-30',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Cherokee 2.8 CRD Limited',
'transmission': 'automatic',
'trim': 'Limited',
'year': 2006}
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML45383%27 HTTP/1.1" 200 None
2026-03-28 21:07:53 [auto1.it] INFO: Saving data for ML45383: {'created_time': 1774732073.658378, 'last_price_update_time': 1774732073.65839, 'auction_closing_time': 1774885833.0}
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ML45383') HTTP/1.1" 204 0
2026-03-28 21:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_d8b6290ffcba83e37bde4738151d5c19.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F20%252Fb2201e7086e1733f795da7b4ad698431%252Fpa%252FRN27083_e28cc829f6f5b0ac0d2a7413dbd7ad79.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_e28cc829f6f5b0ac0d2a7413dbd7ad79.jpg not downloaded yet
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5c%252F8b5cdf0982d8bd309ac826979d4d9f51%252Fpa%252FXP44684_d53729edac5881f08fa3a29847fa21de.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_d53729edac5881f08fa3a29847fa21de.jpg not downloaded yet
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe8%252Fdee8342751f21c9bf5748e438fa52004%252Fpa%252FYX84472_5a469d72b21c4d8d1235ebbdd1e3ac40.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_5a469d72b21c4d8d1235ebbdd1e3ac40.jpg not downloaded yet
2026-03-28 21:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b842daa50>
2026-03-28 21:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c050adfd-2e5f-57fc-84b0-cfdc5d69333e/c050adfd-2e5f-57fc-84b0-cfdc5d69333e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F20%252Fb2201e7086e1733f795da7b4ad698431%252Fpa%252FRN27083_0290400b3f6f181a3e3f2c915d651642.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_0290400b3f6f181a3e3f2c915d651642.jpg saved to cache
2026-03-28 21:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c050adfd-2e5f-57fc-84b0-cfdc5d69333e
2026-03-28 21:07:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3 with identifier: PV47203
2026-03-28 21:07:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3 with scrape type 1
2026-03-28 21:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fb5%252Fe6b54352017b7f12d635372a3b22d354%252Fpa%252FPV47203_83f1c1f0af61cbfbd5da543b587fc5ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_83f1c1f0af61cbfbd5da543b587fc5ec.jpg not downloaded yet
2026-03-28 21:07:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e74903cd-d235-51ba-b19c-bf3c49438536 with identifier: TT70902
2026-03-28 21:07:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e74903cd-d235-51ba-b19c-bf3c49438536 with scrape type 1
2026-03-28 21:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e74903cd-d235-51ba-b19c-bf3c49438536
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fcb%252Fc5cb63035dfc95f130df16b86544c163%252Fpa%252FTT70902_048ed1e759a79034726e16c5af290fa3.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_048ed1e759a79034726e16c5af290fa3.jpg not downloaded yet
2026-03-28 21:07:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac3bd187-57e9-5a7c-8676-a49b3b640f7d with identifier: HY50986
2026-03-28 21:07:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac3bd187-57e9-5a7c-8676-a49b3b640f7d with scrape type 1
2026-03-28 21:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac3bd187-57e9-5a7c-8676-a49b3b640f7d
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff0%252F06f0ac739fac1e4992bade256a87617a%252Fpa%252FHY50986_dbae63849d05926f84750742bc843e22.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_dbae63849d05926f84750742bc843e22.jpg not downloaded yet
2026-03-28 21:07:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2 with identifier: EN63218
2026-03-28 21:07:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2 with scrape type 1
2026-03-28 21:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F4b%252F054bf917f78bf0511dc67ea08b85545d%252Fpa%252FEN63218_f2a83af59f4b1cea9da70c936a90870d.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_f2a83af59f4b1cea9da70c936a90870d.jpg not downloaded yet
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F20%252Fb2201e7086e1733f795da7b4ad698431%252Fpa%252FRN27083_a2698b204b3615c2698e46ae4b214e24.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_a2698b204b3615c2698e46ae4b214e24.jpg not downloaded yet
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5c%252F8b5cdf0982d8bd309ac826979d4d9f51%252Fpa%252FXP44684_135df0a92ac5ccd15589d0e3c287c7d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_135df0a92ac5ccd15589d0e3c287c7d2.jpg not downloaded yet
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe8%252Fdee8342751f21c9bf5748e438fa52004%252Fpa%252FYX84472_3c48745b9bf49074b63ece99298e5415.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_3c48745b9bf49074b63ece99298e5415.jpg not downloaded yet
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fb5%252Fe6b54352017b7f12d635372a3b22d354%252Fpa%252FPV47203_a8a16a0869077d684990264d3aae48b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_a8a16a0869077d684990264d3aae48b8.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fcb%252Fc5cb63035dfc95f130df16b86544c163%252Fpa%252FTT70902_e7da10fc5e114f62b8086cddb3a7e407.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_e7da10fc5e114f62b8086cddb3a7e407.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff0%252F06f0ac739fac1e4992bade256a87617a%252Fpa%252FHY50986_12a9ecea4e53897326991e752f680962.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_12a9ecea4e53897326991e752f680962.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F4b%252F054bf917f78bf0511dc67ea08b85545d%252Fpa%252FEN63218_622b536c0941a75d1bcf675bd966892c.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_622b536c0941a75d1bcf675bd966892c.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5c%252F8b5cdf0982d8bd309ac826979d4d9f51%252Fpa%252FXP44684_688b9cb27568a78a6f16af9a129bf651.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_688b9cb27568a78a6f16af9a129bf651.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe8%252Fdee8342751f21c9bf5748e438fa52004%252Fpa%252FYX84472_528927cb5b247d92bfd0a81e9ea173dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_528927cb5b247d92bfd0a81e9ea173dc.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fb5%252Fe6b54352017b7f12d635372a3b22d354%252Fpa%252FPV47203_085309c910f98069dd1ec7ccd3c86aa2.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_085309c910f98069dd1ec7ccd3c86aa2.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fcb%252Fc5cb63035dfc95f130df16b86544c163%252Fpa%252FTT70902_82215026184121cd176042167e3074c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_82215026184121cd176042167e3074c7.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff0%252F06f0ac739fac1e4992bade256a87617a%252Fpa%252FHY50986_f1cd617386d9cf335393b4cbb6798dbf.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_f1cd617386d9cf335393b4cbb6798dbf.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F4b%252F054bf917f78bf0511dc67ea08b85545d%252Fpa%252FEN63218_6d45a22c002b9325113c3605bc15e420.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_6d45a22c002b9325113c3605bc15e420.jpg not downloaded yet
2026-03-28 21:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b843541d0>
2026-03-28 21:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0501cad-3902-50d7-965a-215a7e41e9f2/f0501cad-3902-50d7-965a-215a7e41e9f2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F7b%252F497b3713317451f19a61afb2eabcc56d%252Fpa%252FNC22560_d8b6290ffcba83e37bde4738151d5c19.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_d8b6290ffcba83e37bde4738151d5c19.jpg saved to cache
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f0501cad-3902-50d7-965a-215a7e41e9f2
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5c%252F8b5cdf0982d8bd309ac826979d4d9f51%252Fpa%252FXP44684_fc5ca513caaff60a30ac432b4a82771e.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_fc5ca513caaff60a30ac432b4a82771e.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe8%252Fdee8342751f21c9bf5748e438fa52004%252Fpa%252FYX84472_3059034482eda4f6731eab75a601c8c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_3059034482eda4f6731eab75a601c8c3.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fb5%252Fe6b54352017b7f12d635372a3b22d354%252Fpa%252FPV47203_12330d594426a0107ae0b516d5b434e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_12330d594426a0107ae0b516d5b434e8.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fcb%252Fc5cb63035dfc95f130df16b86544c163%252Fpa%252FTT70902_aa10e7843454d0e758acb974b2809af8.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_aa10e7843454d0e758acb974b2809af8.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff0%252F06f0ac739fac1e4992bade256a87617a%252Fpa%252FHY50986_97d820d2514f985d7d32ad319d5db0ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_97d820d2514f985d7d32ad319d5db0ee.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F4b%252F054bf917f78bf0511dc67ea08b85545d%252Fpa%252FEN63218_b3ba30f5e0fa8f3b720eace63bb8491a.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_b3ba30f5e0fa8f3b720eace63bb8491a.jpg not downloaded yet
2026-03-28 21:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_3fdfce0a0179bf5fb623d1c3f9764d85.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5c%252F8b5cdf0982d8bd309ac826979d4d9f51%252Fpa%252FXP44684_ae489bcbe199c2442422c033a2539860.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_ae489bcbe199c2442422c033a2539860.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe8%252Fdee8342751f21c9bf5748e438fa52004%252Fpa%252FYX84472_e12840d1627d97a7d8b428dd8154a01f.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_e12840d1627d97a7d8b428dd8154a01f.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fb5%252Fe6b54352017b7f12d635372a3b22d354%252Fpa%252FPV47203_e5ae8f9ffb2c789f60ffcba27dadaf40.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_e5ae8f9ffb2c789f60ffcba27dadaf40.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fcb%252Fc5cb63035dfc95f130df16b86544c163%252Fpa%252FTT70902_d561f97cd24593f9d570c5c8faa0c377.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_d561f97cd24593f9d570c5c8faa0c377.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff0%252F06f0ac739fac1e4992bade256a87617a%252Fpa%252FHY50986_b3475cc8f2dec8cd59cd82fc4a7659eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_b3475cc8f2dec8cd59cd82fc4a7659eb.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F4b%252F054bf917f78bf0511dc67ea08b85545d%252Fpa%252FEN63218_0caccf8cef672e58ef64c412580a519b.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_0caccf8cef672e58ef64c412580a519b.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5c%252F8b5cdf0982d8bd309ac826979d4d9f51%252Fpa%252FXP44684_095fcff36026c3f63e31eb829569d8fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_095fcff36026c3f63e31eb829569d8fe.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe8%252Fdee8342751f21c9bf5748e438fa52004%252Fpa%252FYX84472_61e8490baecc60e242d0ba7180c48440.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_61e8490baecc60e242d0ba7180c48440.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fb5%252Fe6b54352017b7f12d635372a3b22d354%252Fpa%252FPV47203_dc8b573593518c594a8e1716e8857a11.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_dc8b573593518c594a8e1716e8857a11.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fcb%252Fc5cb63035dfc95f130df16b86544c163%252Fpa%252FTT70902_7e2701fab7e0817d9d082db0ae0db411.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_7e2701fab7e0817d9d082db0ae0db411.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff0%252F06f0ac739fac1e4992bade256a87617a%252Fpa%252FHY50986_bdb23d643bc49f04d287ccbe03114602.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_bdb23d643bc49f04d287ccbe03114602.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F4b%252F054bf917f78bf0511dc67ea08b85545d%252Fpa%252FEN63218_23a2a5aabd6b4c4d7fedbc487037178f.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_23a2a5aabd6b4c4d7fedbc487037178f.jpg not downloaded yet
2026-03-28 21:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_a5683c43584a9e8972431898d38b5b5d.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fb5%252Fe6b54352017b7f12d635372a3b22d354%252Fpa%252FPV47203_720804120963bbd1c7e5023b3d64babd.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_720804120963bbd1c7e5023b3d64babd.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fcb%252Fc5cb63035dfc95f130df16b86544c163%252Fpa%252FTT70902_98dc8a19de6a73656d2b94e65c9d6c39.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_98dc8a19de6a73656d2b94e65c9d6c39.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff0%252F06f0ac739fac1e4992bade256a87617a%252Fpa%252FHY50986_99181793b7a7e1dddc805980404b9110.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_99181793b7a7e1dddc805980404b9110.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F4b%252F054bf917f78bf0511dc67ea08b85545d%252Fpa%252FEN63218_9d66bbcbe9610ca042a536bb9a51ea12.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_9d66bbcbe9610ca042a536bb9a51ea12.jpg not downloaded yet
2026-03-28 21:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84275f90>
2026-03-28 21:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c050adfd-2e5f-57fc-84b0-cfdc5d69333e/c050adfd-2e5f-57fc-84b0-cfdc5d69333e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F20%252Fb2201e7086e1733f795da7b4ad698431%252Fpa%252FRN27083_3fdfce0a0179bf5fb623d1c3f9764d85.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_3fdfce0a0179bf5fb623d1c3f9764d85.jpg saved to cache
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c050adfd-2e5f-57fc-84b0-cfdc5d69333e
2026-03-28 21:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_24e7c40c400a576c6b57e6e36880058a.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fb5%252Fe6b54352017b7f12d635372a3b22d354%252Fpa%252FPV47203_38344e1f17aae0ebdd9f4a30bcf8e463.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_38344e1f17aae0ebdd9f4a30bcf8e463.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fcb%252Fc5cb63035dfc95f130df16b86544c163%252Fpa%252FTT70902_d206d8d114850b2b21c71d7c146e888f.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_d206d8d114850b2b21c71d7c146e888f.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff0%252F06f0ac739fac1e4992bade256a87617a%252Fpa%252FHY50986_26771fe107e159cef425cbf17bfff925.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_26771fe107e159cef425cbf17bfff925.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F4b%252F054bf917f78bf0511dc67ea08b85545d%252Fpa%252FEN63218_db36021a7ba628f407beeaeba567f483.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_db36021a7ba628f407beeaeba567f483.jpg not downloaded yet
2026-03-28 21:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_0f8b7ae7768613cc3d8b62c0ef708216.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fb5%252Fe6b54352017b7f12d635372a3b22d354%252Fpa%252FPV47203_91790f3254ff01747d01184dfb8273d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_91790f3254ff01747d01184dfb8273d0.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fcb%252Fc5cb63035dfc95f130df16b86544c163%252Fpa%252FTT70902_d47b4eb0558dc9acfdd8a4b40acd8009.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_d47b4eb0558dc9acfdd8a4b40acd8009.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff0%252F06f0ac739fac1e4992bade256a87617a%252Fpa%252FHY50986_68bdc9d4753c3af02eb9ae00d76db5e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_68bdc9d4753c3af02eb9ae00d76db5e6.jpg not downloaded yet
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F4b%252F054bf917f78bf0511dc67ea08b85545d%252Fpa%252FEN63218_cbdb8b7ef813c82d56f79c3d8c7fa529.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_cbdb8b7ef813c82d56f79c3d8c7fa529.jpg not downloaded yet
2026-03-28 21:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_4ab80f427eee70f7e747589566aa45bc.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84274990>
2026-03-28 21:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bc4af0b-876b-5cba-9ed6-488e968d3fa6/9bc4af0b-876b-5cba-9ed6-488e968d3fa6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe8%252Fdee8342751f21c9bf5748e438fa52004%252Fpa%252FYX84472_a5683c43584a9e8972431898d38b5b5d.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_a5683c43584a9e8972431898d38b5b5d.jpg saved to cache
2026-03-28 21:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9bc4af0b-876b-5cba-9ed6-488e968d3fa6
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fb5%252Fe6b54352017b7f12d635372a3b22d354%252Fpa%252FPV47203_4a75af54da2d5af8459b0c0e8cdec54d.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_4a75af54da2d5af8459b0c0e8cdec54d.jpg not downloaded yet
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fcb%252Fc5cb63035dfc95f130df16b86544c163%252Fpa%252FTT70902_4511b6ed0cfb02c96950712c91337abc.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_4511b6ed0cfb02c96950712c91337abc.jpg not downloaded yet
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff0%252F06f0ac739fac1e4992bade256a87617a%252Fpa%252FHY50986_d2e3db582b11e002a6735b18e6267991.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_d2e3db582b11e002a6735b18e6267991.jpg not downloaded yet
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F4b%252F054bf917f78bf0511dc67ea08b85545d%252Fpa%252FEN63218_0d595bd816597e62b0928119f07b8f10.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_0d595bd816597e62b0928119f07b8f10.jpg not downloaded yet
2026-03-28 21:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_765438eb88e95965ec8374dfab616d29.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_7dfaeebf58682ca3efff52724807c9d3.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b85cb7b90>
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81530959-605c-535f-b6f7-1f7bdfec6fc4/81530959-605c-535f-b6f7-1f7bdfec6fc4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F90%252Fa9909a0300bce01faae40b5855ada059%252Fpa%252FCY56164_24e7c40c400a576c6b57e6e36880058a.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_24e7c40c400a576c6b57e6e36880058a.jpg saved to cache
2026-03-28 21:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 81530959-605c-535f-b6f7-1f7bdfec6fc4
2026-03-28 21:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_0fb87e1320274f9984c3e20dea2ac733.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_e990ba774f95e477dfce1b674481ee50.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_3606238e001e986491ea10180ed6f724.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7ee0e5d0>
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81530959-605c-535f-b6f7-1f7bdfec6fc4/81530959-605c-535f-b6f7-1f7bdfec6fc4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F90%252Fa9909a0300bce01faae40b5855ada059%252Fpa%252FCY56164_0f8b7ae7768613cc3d8b62c0ef708216.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_0f8b7ae7768613cc3d8b62c0ef708216.jpg saved to cache
2026-03-28 21:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 81530959-605c-535f-b6f7-1f7bdfec6fc4
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84237bd0>
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_635da28b-5aac-5a71-be90-9c51a7875148/635da28b-5aac-5a71-be90-9c51a7875148_image_0.jpg HTTP/1.1" 201 0
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5c%252F8b5cdf0982d8bd309ac826979d4d9f51%252Fpa%252FXP44684_4ab80f427eee70f7e747589566aa45bc.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_4ab80f427eee70f7e747589566aa45bc.jpg saved to cache
2026-03-28 21:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 635da28b-5aac-5a71-be90-9c51a7875148
2026-03-28 21:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_992a3715f8873c4973b4ec6d9da7d095.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b841435d0>
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81530959-605c-535f-b6f7-1f7bdfec6fc4/81530959-605c-535f-b6f7-1f7bdfec6fc4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F90%252Fa9909a0300bce01faae40b5855ada059%252Fpa%252FCY56164_765438eb88e95965ec8374dfab616d29.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_765438eb88e95965ec8374dfab616d29.jpg saved to cache
2026-03-28 21:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 81530959-605c-535f-b6f7-1f7bdfec6fc4
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7eedd1d0>
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_635da28b-5aac-5a71-be90-9c51a7875148/635da28b-5aac-5a71-be90-9c51a7875148_image_1.jpg HTTP/1.1" 201 0
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5c%252F8b5cdf0982d8bd309ac826979d4d9f51%252Fpa%252FXP44684_7dfaeebf58682ca3efff52724807c9d3.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_7dfaeebf58682ca3efff52724807c9d3.jpg saved to cache
2026-03-28 21:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 635da28b-5aac-5a71-be90-9c51a7875148
2026-03-28 21:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_506bb2751287c22a67e4cb871eed65f7.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_2753f70f2747d81e3f991cb664477c1c.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84274e10>
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81530959-605c-535f-b6f7-1f7bdfec6fc4/81530959-605c-535f-b6f7-1f7bdfec6fc4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F90%252Fa9909a0300bce01faae40b5855ada059%252Fpa%252FCY56164_0fb87e1320274f9984c3e20dea2ac733.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_0fb87e1320274f9984c3e20dea2ac733.jpg saved to cache
2026-03-28 21:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 81530959-605c-535f-b6f7-1f7bdfec6fc4
2026-03-28 21:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7ee9d1d0>
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81530959-605c-535f-b6f7-1f7bdfec6fc4/81530959-605c-535f-b6f7-1f7bdfec6fc4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F90%252Fa9909a0300bce01faae40b5855ada059%252Fpa%252FCY56164_e990ba774f95e477dfce1b674481ee50.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_e990ba774f95e477dfce1b674481ee50.jpg saved to cache
2026-03-28 21:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 81530959-605c-535f-b6f7-1f7bdfec6fc4
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8419e2d0>
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bc4af0b-876b-5cba-9ed6-488e968d3fa6/9bc4af0b-876b-5cba-9ed6-488e968d3fa6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe8%252Fdee8342751f21c9bf5748e438fa52004%252Fpa%252FYX84472_3606238e001e986491ea10180ed6f724.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_3606238e001e986491ea10180ed6f724.jpg saved to cache
2026-03-28 21:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9bc4af0b-876b-5cba-9ed6-488e968d3fa6
2026-03-28 21:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_9d66bbcbe9610ca042a536bb9a51ea12.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84381590>
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c050adfd-2e5f-57fc-84b0-cfdc5d69333e/c050adfd-2e5f-57fc-84b0-cfdc5d69333e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F20%252Fb2201e7086e1733f795da7b4ad698431%252Fpa%252FRN27083_992a3715f8873c4973b4ec6d9da7d095.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_992a3715f8873c4973b4ec6d9da7d095.jpg saved to cache
2026-03-28 21:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c050adfd-2e5f-57fc-84b0-cfdc5d69333e
2026-03-28 21:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_6d45a22c002b9325113c3605bc15e420.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_23a2a5aabd6b4c4d7fedbc487037178f.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7eea0210>
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bc4af0b-876b-5cba-9ed6-488e968d3fa6/9bc4af0b-876b-5cba-9ed6-488e968d3fa6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe8%252Fdee8342751f21c9bf5748e438fa52004%252Fpa%252FYX84472_506bb2751287c22a67e4cb871eed65f7.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_506bb2751287c22a67e4cb871eed65f7.jpg saved to cache
2026-03-28 21:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9bc4af0b-876b-5cba-9ed6-488e968d3fa6
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7ee0db50>
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c050adfd-2e5f-57fc-84b0-cfdc5d69333e/c050adfd-2e5f-57fc-84b0-cfdc5d69333e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F20%252Fb2201e7086e1733f795da7b4ad698431%252Fpa%252FRN27083_2753f70f2747d81e3f991cb664477c1c.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_2753f70f2747d81e3f991cb664477c1c.jpg saved to cache
2026-03-28 21:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c050adfd-2e5f-57fc-84b0-cfdc5d69333e
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8432f1d0>
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2/2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F4b%252F054bf917f78bf0511dc67ea08b85545d%252Fpa%252FEN63218_9d66bbcbe9610ca042a536bb9a51ea12.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_9d66bbcbe9610ca042a536bb9a51ea12.jpg saved to cache
2026-03-28 21:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84145450>
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2/2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F4b%252F054bf917f78bf0511dc67ea08b85545d%252Fpa%252FEN63218_6d45a22c002b9325113c3605bc15e420.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_6d45a22c002b9325113c3605bc15e420.jpg saved to cache
2026-03-28 21:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7eedcbd0>
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2/2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F4b%252F054bf917f78bf0511dc67ea08b85545d%252Fpa%252FEN63218_23a2a5aabd6b4c4d7fedbc487037178f.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_23a2a5aabd6b4c4d7fedbc487037178f.jpg saved to cache
2026-03-28 21:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2
2026-03-28 21:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_68bdc9d4753c3af02eb9ae00d76db5e6.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_d2e3db582b11e002a6735b18e6267991.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_350021c844761f684e5fc3e767631c93.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_42072b7cfbfb9b72fb87eb2190155ad8.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_4a75af54da2d5af8459b0c0e8cdec54d.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_0d595bd816597e62b0928119f07b8f10.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_cbdb8b7ef813c82d56f79c3d8c7fa529.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_4511b6ed0cfb02c96950712c91337abc.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_26771fe107e159cef425cbf17bfff925.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_99181793b7a7e1dddc805980404b9110.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8419d7d0>
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3bd187-57e9-5a7c-8676-a49b3b640f7d/ac3bd187-57e9-5a7c-8676-a49b3b640f7d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff0%252F06f0ac739fac1e4992bade256a87617a%252Fpa%252FHY50986_68bdc9d4753c3af02eb9ae00d76db5e6.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_68bdc9d4753c3af02eb9ae00d76db5e6.jpg saved to cache
2026-03-28 21:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ac3bd187-57e9-5a7c-8676-a49b3b640f7d
2026-03-28 21:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_bdb23d643bc49f04d287ccbe03114602.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8432f610>
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3bd187-57e9-5a7c-8676-a49b3b640f7d/ac3bd187-57e9-5a7c-8676-a49b3b640f7d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff0%252F06f0ac739fac1e4992bade256a87617a%252Fpa%252FHY50986_d2e3db582b11e002a6735b18e6267991.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_d2e3db582b11e002a6735b18e6267991.jpg saved to cache
2026-03-28 21:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ac3bd187-57e9-5a7c-8676-a49b3b640f7d
2026-03-28 21:07:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84280450>
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81530959-605c-535f-b6f7-1f7bdfec6fc4/81530959-605c-535f-b6f7-1f7bdfec6fc4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F90%252Fa9909a0300bce01faae40b5855ada059%252Fpa%252FCY56164_350021c844761f684e5fc3e767631c93.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_350021c844761f684e5fc3e767631c93.jpg saved to cache
2026-03-28 21:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 81530959-605c-535f-b6f7-1f7bdfec6fc4
2026-03-28 21:07:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b842ac250>
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81530959-605c-535f-b6f7-1f7bdfec6fc4/81530959-605c-535f-b6f7-1f7bdfec6fc4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F90%252Fa9909a0300bce01faae40b5855ada059%252Fpa%252FCY56164_42072b7cfbfb9b72fb87eb2190155ad8.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_42072b7cfbfb9b72fb87eb2190155ad8.jpg saved to cache
2026-03-28 21:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 81530959-605c-535f-b6f7-1f7bdfec6fc4
2026-03-28 21:07:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 81530959-605c-535f-b6f7-1f7bdfec6fc4, skipping ID generation
2026-03-28 21:07:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81530959-605c-535f-b6f7-1f7bdfec6fc4 with scrape type 1
2026-03-28 21:07:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 81530959-605c-535f-b6f7-1f7bdfec6fc4 sending to next pipeline
2026-03-28 21:07:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 81530959-605c-535f-b6f7-1f7bdfec6fc4, identifier: CY56164
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7eeb3050>
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fb5%252Fe6b54352017b7f12d635372a3b22d354%252Fpa%252FPV47203_4a75af54da2d5af8459b0c0e8cdec54d.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_4a75af54da2d5af8459b0c0e8cdec54d.jpg saved to cache
2026-03-28 21:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84230c50>
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2/2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F4b%252F054bf917f78bf0511dc67ea08b85545d%252Fpa%252FEN63218_0d595bd816597e62b0928119f07b8f10.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_0d595bd816597e62b0928119f07b8f10.jpg saved to cache
2026-03-28 21:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b843110d0>
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2/2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F4b%252F054bf917f78bf0511dc67ea08b85545d%252Fpa%252FEN63218_cbdb8b7ef813c82d56f79c3d8c7fa529.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_cbdb8b7ef813c82d56f79c3d8c7fa529.jpg saved to cache
2026-03-28 21:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8419ca10>
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e74903cd-d235-51ba-b19c-bf3c49438536/e74903cd-d235-51ba-b19c-bf3c49438536_image_9.jpg HTTP/1.1" 201 0
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fcb%252Fc5cb63035dfc95f130df16b86544c163%252Fpa%252FTT70902_4511b6ed0cfb02c96950712c91337abc.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_4511b6ed0cfb02c96950712c91337abc.jpg saved to cache
2026-03-28 21:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e74903cd-d235-51ba-b19c-bf3c49438536
2026-03-28 21:07:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 81530959-605c-535f-b6f7-1f7bdfec6fc4 with identifier: CY56164
2026-03-28 21:07:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 81530959-605c-535f-b6f7-1f7bdfec6fc4 with identifier: CY56164
2026-03-28 21:07:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 81530959-605c-535f-b6f7-1f7bdfec6fc4 with identifier: CY56164 to the API
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:07:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_42072b7cfbfb9b72fb87eb2190155ad8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 209,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.9L',
'engine_horse_power': 440,
'expiration_date': '2026-03-30T15:05:24Z',
'fuel_type': 'petrol',
'id': '81530959-605c-535f-b6f7-1f7bdfec6fc4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY56164',
'listing': 'auction',
'location': 'IT, Nola',
'make': 'Porsche',
'model': 'Cayenne',
'odometer': 115505,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81530959-605c-535f-b6f7-1f7bdfec6fc4/81530959-605c-535f-b6f7-1f7bdfec6fc4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3476449,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_02cf2003a13e33023733eb6f51a2a0cb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81530959-605c-535f-b6f7-1f7bdfec6fc4/81530959-605c-535f-b6f7-1f7bdfec6fc4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3342502,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_42072b7cfbfb9b72fb87eb2190155ad8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81530959-605c-535f-b6f7-1f7bdfec6fc4/81530959-605c-535f-b6f7-1f7bdfec6fc4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3043386,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_350021c844761f684e5fc3e767631c93.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81530959-605c-535f-b6f7-1f7bdfec6fc4/81530959-605c-535f-b6f7-1f7bdfec6fc4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3012585,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_f266668d4535b502d39815f1cab87878.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81530959-605c-535f-b6f7-1f7bdfec6fc4/81530959-605c-535f-b6f7-1f7bdfec6fc4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3122250,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_11af315dc2b5bce77fbc4d25dd9a209a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81530959-605c-535f-b6f7-1f7bdfec6fc4/81530959-605c-535f-b6f7-1f7bdfec6fc4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2651248,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_e990ba774f95e477dfce1b674481ee50.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81530959-605c-535f-b6f7-1f7bdfec6fc4/81530959-605c-535f-b6f7-1f7bdfec6fc4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2511217,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_765438eb88e95965ec8374dfab616d29.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81530959-605c-535f-b6f7-1f7bdfec6fc4/81530959-605c-535f-b6f7-1f7bdfec6fc4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2830167,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_24e7c40c400a576c6b57e6e36880058a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81530959-605c-535f-b6f7-1f7bdfec6fc4/81530959-605c-535f-b6f7-1f7bdfec6fc4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3375529,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_0fb87e1320274f9984c3e20dea2ac733.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81530959-605c-535f-b6f7-1f7bdfec6fc4/81530959-605c-535f-b6f7-1f7bdfec6fc4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2965475,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga9/90/a9909a0300bce01faae40b5855ada059/pa/CY56164_0f8b7ae7768613cc3d8b62c0ef708216.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-09-20',
'seats_number': 5,
'seller_name': None,
'title': 'Porsche Cayenne S',
'transmission': 'automatic',
'trim': '',
'year': 2018}
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CY56164%27 HTTP/1.1" 200 None
2026-03-28 21:07:57 [auto1.it] INFO: Saving data for CY56164: {'created_time': 1774732077.568238, 'last_price_update_time': 1774732077.568247, 'auction_closing_time': 1774883124.0}
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CY56164') HTTP/1.1" 204 0
2026-03-28 21:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_d47b4eb0558dc9acfdd8a4b40acd8009.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_98dc8a19de6a73656d2b94e65c9d6c39.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_720804120963bbd1c7e5023b3d64babd.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_91790f3254ff01747d01184dfb8273d0.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_d206d8d114850b2b21c71d7c146e888f.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_38344e1f17aae0ebdd9f4a30bcf8e463.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_db36021a7ba628f407beeaeba567f483.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84237050>
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3bd187-57e9-5a7c-8676-a49b3b640f7d/ac3bd187-57e9-5a7c-8676-a49b3b640f7d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff0%252F06f0ac739fac1e4992bade256a87617a%252Fpa%252FHY50986_26771fe107e159cef425cbf17bfff925.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_26771fe107e159cef425cbf17bfff925.jpg saved to cache
2026-03-28 21:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ac3bd187-57e9-5a7c-8676-a49b3b640f7d
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7eeb7fd0>
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3bd187-57e9-5a7c-8676-a49b3b640f7d/ac3bd187-57e9-5a7c-8676-a49b3b640f7d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff0%252F06f0ac739fac1e4992bade256a87617a%252Fpa%252FHY50986_99181793b7a7e1dddc805980404b9110.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_99181793b7a7e1dddc805980404b9110.jpg saved to cache
2026-03-28 21:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ac3bd187-57e9-5a7c-8676-a49b3b640f7d
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84314a90>
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3bd187-57e9-5a7c-8676-a49b3b640f7d/ac3bd187-57e9-5a7c-8676-a49b3b640f7d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff0%252F06f0ac739fac1e4992bade256a87617a%252Fpa%252FHY50986_bdb23d643bc49f04d287ccbe03114602.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_bdb23d643bc49f04d287ccbe03114602.jpg saved to cache
2026-03-28 21:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ac3bd187-57e9-5a7c-8676-a49b3b640f7d
2026-03-28 21:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_b3475cc8f2dec8cd59cd82fc4a7659eb.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7eeb7850>
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e74903cd-d235-51ba-b19c-bf3c49438536/e74903cd-d235-51ba-b19c-bf3c49438536_image_8.jpg HTTP/1.1" 201 0
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fcb%252Fc5cb63035dfc95f130df16b86544c163%252Fpa%252FTT70902_d47b4eb0558dc9acfdd8a4b40acd8009.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_d47b4eb0558dc9acfdd8a4b40acd8009.jpg saved to cache
2026-03-28 21:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e74903cd-d235-51ba-b19c-bf3c49438536
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b841c2e50>
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e74903cd-d235-51ba-b19c-bf3c49438536/e74903cd-d235-51ba-b19c-bf3c49438536_image_6.jpg HTTP/1.1" 201 0
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fcb%252Fc5cb63035dfc95f130df16b86544c163%252Fpa%252FTT70902_98dc8a19de6a73656d2b94e65c9d6c39.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_98dc8a19de6a73656d2b94e65c9d6c39.jpg saved to cache
2026-03-28 21:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e74903cd-d235-51ba-b19c-bf3c49438536
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7f7c9350>
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fb5%252Fe6b54352017b7f12d635372a3b22d354%252Fpa%252FPV47203_720804120963bbd1c7e5023b3d64babd.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_720804120963bbd1c7e5023b3d64babd.jpg saved to cache
2026-03-28 21:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7ee85390>
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fb5%252Fe6b54352017b7f12d635372a3b22d354%252Fpa%252FPV47203_91790f3254ff01747d01184dfb8273d0.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_91790f3254ff01747d01184dfb8273d0.jpg saved to cache
2026-03-28 21:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8430c190>
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e74903cd-d235-51ba-b19c-bf3c49438536/e74903cd-d235-51ba-b19c-bf3c49438536_image_7.jpg HTTP/1.1" 201 0
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fcb%252Fc5cb63035dfc95f130df16b86544c163%252Fpa%252FTT70902_d206d8d114850b2b21c71d7c146e888f.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_d206d8d114850b2b21c71d7c146e888f.jpg saved to cache
2026-03-28 21:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e74903cd-d235-51ba-b19c-bf3c49438536
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b842f8050>
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fb5%252Fe6b54352017b7f12d635372a3b22d354%252Fpa%252FPV47203_38344e1f17aae0ebdd9f4a30bcf8e463.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_38344e1f17aae0ebdd9f4a30bcf8e463.jpg saved to cache
2026-03-28 21:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8410f410>
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2/2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F4b%252F054bf917f78bf0511dc67ea08b85545d%252Fpa%252FEN63218_db36021a7ba628f407beeaeba567f483.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_db36021a7ba628f407beeaeba567f483.jpg saved to cache
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2
2026-03-28 21:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_61e8490baecc60e242d0ba7180c48440.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_0caccf8cef672e58ef64c412580a519b.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_095fcff36026c3f63e31eb829569d8fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_7e2701fab7e0817d9d082db0ae0db411.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_d561f97cd24593f9d570c5c8faa0c377.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_dc8b573593518c594a8e1716e8857a11.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_e5ae8f9ffb2c789f60ffcba27dadaf40.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84312ed0>
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3bd187-57e9-5a7c-8676-a49b3b640f7d/ac3bd187-57e9-5a7c-8676-a49b3b640f7d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff0%252F06f0ac739fac1e4992bade256a87617a%252Fpa%252FHY50986_b3475cc8f2dec8cd59cd82fc4a7659eb.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_b3475cc8f2dec8cd59cd82fc4a7659eb.jpg saved to cache
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ac3bd187-57e9-5a7c-8676-a49b3b640f7d
2026-03-28 21:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_97d820d2514f985d7d32ad319d5db0ee.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7f746990>
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bc4af0b-876b-5cba-9ed6-488e968d3fa6/9bc4af0b-876b-5cba-9ed6-488e968d3fa6_image_9.jpg HTTP/1.1" 201 0
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe8%252Fdee8342751f21c9bf5748e438fa52004%252Fpa%252FYX84472_61e8490baecc60e242d0ba7180c48440.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_61e8490baecc60e242d0ba7180c48440.jpg saved to cache
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9bc4af0b-876b-5cba-9ed6-488e968d3fa6
2026-03-28 21:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_f1cd617386d9cf335393b4cbb6798dbf.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7eed4490>
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2/2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F4b%252F054bf917f78bf0511dc67ea08b85545d%252Fpa%252FEN63218_0caccf8cef672e58ef64c412580a519b.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_0caccf8cef672e58ef64c412580a519b.jpg saved to cache
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8413ac50>
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_635da28b-5aac-5a71-be90-9c51a7875148/635da28b-5aac-5a71-be90-9c51a7875148_image_9.jpg HTTP/1.1" 201 0
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5c%252F8b5cdf0982d8bd309ac826979d4d9f51%252Fpa%252FXP44684_095fcff36026c3f63e31eb829569d8fe.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_095fcff36026c3f63e31eb829569d8fe.jpg saved to cache
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 635da28b-5aac-5a71-be90-9c51a7875148
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84315990>
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e74903cd-d235-51ba-b19c-bf3c49438536/e74903cd-d235-51ba-b19c-bf3c49438536_image_5.jpg HTTP/1.1" 201 0
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fcb%252Fc5cb63035dfc95f130df16b86544c163%252Fpa%252FTT70902_7e2701fab7e0817d9d082db0ae0db411.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_7e2701fab7e0817d9d082db0ae0db411.jpg saved to cache
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e74903cd-d235-51ba-b19c-bf3c49438536
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7f7d3710>
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e74903cd-d235-51ba-b19c-bf3c49438536/e74903cd-d235-51ba-b19c-bf3c49438536_image_4.jpg HTTP/1.1" 201 0
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fcb%252Fc5cb63035dfc95f130df16b86544c163%252Fpa%252FTT70902_d561f97cd24593f9d570c5c8faa0c377.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_d561f97cd24593f9d570c5c8faa0c377.jpg saved to cache
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e74903cd-d235-51ba-b19c-bf3c49438536
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b841c0210>
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fb5%252Fe6b54352017b7f12d635372a3b22d354%252Fpa%252FPV47203_dc8b573593518c594a8e1716e8857a11.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_dc8b573593518c594a8e1716e8857a11.jpg saved to cache
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b843ae710>
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fb5%252Fe6b54352017b7f12d635372a3b22d354%252Fpa%252FPV47203_e5ae8f9ffb2c789f60ffcba27dadaf40.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_e5ae8f9ffb2c789f60ffcba27dadaf40.jpg saved to cache
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3
2026-03-28 21:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_e12840d1627d97a7d8b428dd8154a01f.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_ae489bcbe199c2442422c033a2539860.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_aa10e7843454d0e758acb974b2809af8.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_12330d594426a0107ae0b516d5b434e8.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_82215026184121cd176042167e3074c7.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_3059034482eda4f6731eab75a601c8c3.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_b3ba30f5e0fa8f3b720eace63bb8491a.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_fc5ca513caaff60a30ac432b4a82771e.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_12a9ecea4e53897326991e752f680962.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7f7bae10>
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3bd187-57e9-5a7c-8676-a49b3b640f7d/ac3bd187-57e9-5a7c-8676-a49b3b640f7d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff0%252F06f0ac739fac1e4992bade256a87617a%252Fpa%252FHY50986_97d820d2514f985d7d32ad319d5db0ee.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_97d820d2514f985d7d32ad319d5db0ee.jpg saved to cache
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ac3bd187-57e9-5a7c-8676-a49b3b640f7d
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84217310>
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3bd187-57e9-5a7c-8676-a49b3b640f7d/ac3bd187-57e9-5a7c-8676-a49b3b640f7d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff0%252F06f0ac739fac1e4992bade256a87617a%252Fpa%252FHY50986_f1cd617386d9cf335393b4cbb6798dbf.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_f1cd617386d9cf335393b4cbb6798dbf.jpg saved to cache
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ac3bd187-57e9-5a7c-8676-a49b3b640f7d
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84323710>
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bc4af0b-876b-5cba-9ed6-488e968d3fa6/9bc4af0b-876b-5cba-9ed6-488e968d3fa6_image_8.jpg HTTP/1.1" 201 0
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe8%252Fdee8342751f21c9bf5748e438fa52004%252Fpa%252FYX84472_e12840d1627d97a7d8b428dd8154a01f.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_e12840d1627d97a7d8b428dd8154a01f.jpg saved to cache
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9bc4af0b-876b-5cba-9ed6-488e968d3fa6
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8614ca50>
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_635da28b-5aac-5a71-be90-9c51a7875148/635da28b-5aac-5a71-be90-9c51a7875148_image_8.jpg HTTP/1.1" 201 0
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5c%252F8b5cdf0982d8bd309ac826979d4d9f51%252Fpa%252FXP44684_ae489bcbe199c2442422c033a2539860.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_ae489bcbe199c2442422c033a2539860.jpg saved to cache
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 635da28b-5aac-5a71-be90-9c51a7875148
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b840c0410>
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e74903cd-d235-51ba-b19c-bf3c49438536/e74903cd-d235-51ba-b19c-bf3c49438536_image_3.jpg HTTP/1.1" 201 0
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fcb%252Fc5cb63035dfc95f130df16b86544c163%252Fpa%252FTT70902_aa10e7843454d0e758acb974b2809af8.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_aa10e7843454d0e758acb974b2809af8.jpg saved to cache
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e74903cd-d235-51ba-b19c-bf3c49438536
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8412d7d0>
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fb5%252Fe6b54352017b7f12d635372a3b22d354%252Fpa%252FPV47203_12330d594426a0107ae0b516d5b434e8.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_12330d594426a0107ae0b516d5b434e8.jpg saved to cache
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b842a1e50>
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e74903cd-d235-51ba-b19c-bf3c49438536/e74903cd-d235-51ba-b19c-bf3c49438536_image_2.jpg HTTP/1.1" 201 0
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fcb%252Fc5cb63035dfc95f130df16b86544c163%252Fpa%252FTT70902_82215026184121cd176042167e3074c7.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_82215026184121cd176042167e3074c7.jpg saved to cache
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e74903cd-d235-51ba-b19c-bf3c49438536
2026-03-28 21:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_622b536c0941a75d1bcf675bd966892c.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_085309c910f98069dd1ec7ccd3c86aa2.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_688b9cb27568a78a6f16af9a129bf651.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_528927cb5b247d92bfd0a81e9ea173dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_3c48745b9bf49074b63ece99298e5415.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_135df0a92ac5ccd15589d0e3c287c7d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_e7da10fc5e114f62b8086cddb3a7e407.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_a8a16a0869077d684990264d3aae48b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84246a50>
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bc4af0b-876b-5cba-9ed6-488e968d3fa6/9bc4af0b-876b-5cba-9ed6-488e968d3fa6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe8%252Fdee8342751f21c9bf5748e438fa52004%252Fpa%252FYX84472_3059034482eda4f6731eab75a601c8c3.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_3059034482eda4f6731eab75a601c8c3.jpg saved to cache
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9bc4af0b-876b-5cba-9ed6-488e968d3fa6
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8438f690>
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2/2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F4b%252F054bf917f78bf0511dc67ea08b85545d%252Fpa%252FEN63218_b3ba30f5e0fa8f3b720eace63bb8491a.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_b3ba30f5e0fa8f3b720eace63bb8491a.jpg saved to cache
2026-03-28 21:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b840ebb50>
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_635da28b-5aac-5a71-be90-9c51a7875148/635da28b-5aac-5a71-be90-9c51a7875148_image_7.jpg HTTP/1.1" 201 0
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5c%252F8b5cdf0982d8bd309ac826979d4d9f51%252Fpa%252FXP44684_fc5ca513caaff60a30ac432b4a82771e.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_fc5ca513caaff60a30ac432b4a82771e.jpg saved to cache
2026-03-28 21:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 635da28b-5aac-5a71-be90-9c51a7875148
2026-03-28 21:07:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8438edd0>
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3bd187-57e9-5a7c-8676-a49b3b640f7d/ac3bd187-57e9-5a7c-8676-a49b3b640f7d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff0%252F06f0ac739fac1e4992bade256a87617a%252Fpa%252FHY50986_12a9ecea4e53897326991e752f680962.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_12a9ecea4e53897326991e752f680962.jpg saved to cache
2026-03-28 21:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ac3bd187-57e9-5a7c-8676-a49b3b640f7d
2026-03-28 21:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_f2a83af59f4b1cea9da70c936a90870d.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_dbae63849d05926f84750742bc843e22.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8419e650>
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2/2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F4b%252F054bf917f78bf0511dc67ea08b85545d%252Fpa%252FEN63218_622b536c0941a75d1bcf675bd966892c.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_622b536c0941a75d1bcf675bd966892c.jpg saved to cache
2026-03-28 21:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7f704350>
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fb5%252Fe6b54352017b7f12d635372a3b22d354%252Fpa%252FPV47203_085309c910f98069dd1ec7ccd3c86aa2.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_085309c910f98069dd1ec7ccd3c86aa2.jpg saved to cache
2026-03-28 21:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84130590>
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_635da28b-5aac-5a71-be90-9c51a7875148/635da28b-5aac-5a71-be90-9c51a7875148_image_6.jpg HTTP/1.1" 201 0
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5c%252F8b5cdf0982d8bd309ac826979d4d9f51%252Fpa%252FXP44684_688b9cb27568a78a6f16af9a129bf651.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_688b9cb27568a78a6f16af9a129bf651.jpg saved to cache
2026-03-28 21:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 635da28b-5aac-5a71-be90-9c51a7875148
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b841958d0>
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bc4af0b-876b-5cba-9ed6-488e968d3fa6/9bc4af0b-876b-5cba-9ed6-488e968d3fa6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe8%252Fdee8342751f21c9bf5748e438fa52004%252Fpa%252FYX84472_528927cb5b247d92bfd0a81e9ea173dc.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_528927cb5b247d92bfd0a81e9ea173dc.jpg saved to cache
2026-03-28 21:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9bc4af0b-876b-5cba-9ed6-488e968d3fa6
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84132750>
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bc4af0b-876b-5cba-9ed6-488e968d3fa6/9bc4af0b-876b-5cba-9ed6-488e968d3fa6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe8%252Fdee8342751f21c9bf5748e438fa52004%252Fpa%252FYX84472_3c48745b9bf49074b63ece99298e5415.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_3c48745b9bf49074b63ece99298e5415.jpg saved to cache
2026-03-28 21:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9bc4af0b-876b-5cba-9ed6-488e968d3fa6
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7f7060d0>
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_635da28b-5aac-5a71-be90-9c51a7875148/635da28b-5aac-5a71-be90-9c51a7875148_image_5.jpg HTTP/1.1" 201 0
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5c%252F8b5cdf0982d8bd309ac826979d4d9f51%252Fpa%252FXP44684_135df0a92ac5ccd15589d0e3c287c7d2.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_135df0a92ac5ccd15589d0e3c287c7d2.jpg saved to cache
2026-03-28 21:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 635da28b-5aac-5a71-be90-9c51a7875148
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8411a610>
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e74903cd-d235-51ba-b19c-bf3c49438536/e74903cd-d235-51ba-b19c-bf3c49438536_image_1.jpg HTTP/1.1" 201 0
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fcb%252Fc5cb63035dfc95f130df16b86544c163%252Fpa%252FTT70902_e7da10fc5e114f62b8086cddb3a7e407.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_e7da10fc5e114f62b8086cddb3a7e407.jpg saved to cache
2026-03-28 21:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e74903cd-d235-51ba-b19c-bf3c49438536
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84132d50>
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fb5%252Fe6b54352017b7f12d635372a3b22d354%252Fpa%252FPV47203_a8a16a0869077d684990264d3aae48b8.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_a8a16a0869077d684990264d3aae48b8.jpg saved to cache
2026-03-28 21:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3
2026-03-28 21:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_a2698b204b3615c2698e46ae4b214e24.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_d53729edac5881f08fa3a29847fa21de.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_5a469d72b21c4d8d1235ebbdd1e3ac40.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_d27521567566c9b48c21be9daaffb234.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_83f1c1f0af61cbfbd5da543b587fc5ec.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_048ed1e759a79034726e16c5af290fa3.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_e28cc829f6f5b0ac0d2a7413dbd7ad79.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:07:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7eed7050>
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2/2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F4b%252F054bf917f78bf0511dc67ea08b85545d%252Fpa%252FEN63218_f2a83af59f4b1cea9da70c936a90870d.jpg') HTTP/1.1" 204 0
2026-03-28 21:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_f2a83af59f4b1cea9da70c936a90870d.jpg saved to cache
2026-03-28 21:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2
2026-03-28 21:07:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2, skipping ID generation
2026-03-28 21:07:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2 with scrape type 1
2026-03-28 21:07:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2 sending to next pipeline
2026-03-28 21:07:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2, identifier: EN63218
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7ee44990>
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3bd187-57e9-5a7c-8676-a49b3b640f7d/ac3bd187-57e9-5a7c-8676-a49b3b640f7d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 21:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Ff0%252F06f0ac739fac1e4992bade256a87617a%252Fpa%252FHY50986_dbae63849d05926f84750742bc843e22.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_dbae63849d05926f84750742bc843e22.jpg saved to cache
2026-03-28 21:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac3bd187-57e9-5a7c-8676-a49b3b640f7d
2026-03-28 21:08:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac3bd187-57e9-5a7c-8676-a49b3b640f7d, skipping ID generation
2026-03-28 21:08:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac3bd187-57e9-5a7c-8676-a49b3b640f7d with scrape type 1
2026-03-28 21:08:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac3bd187-57e9-5a7c-8676-a49b3b640f7d sending to next pipeline
2026-03-28 21:08:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ac3bd187-57e9-5a7c-8676-a49b3b640f7d, identifier: HY50986
2026-03-28 21:08:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2 with identifier: EN63218
2026-03-28 21:08:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2 with identifier: EN63218
2026-03-28 21:08:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2 with identifier: EN63218 to the API
2026-03-28 21:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:08:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_f2a83af59f4b1cea9da70c936a90870d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.6L',
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:54:16Z',
'fuel_type': 'diesel',
'id': '2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN63218',
'listing': 'auction',
'location': 'IT, Agliana (PT)',
'make': 'Jeep',
'model': 'Compass',
'odometer': 72819,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2/2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64133,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_f2a83af59f4b1cea9da70c936a90870d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2/2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69766,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_622b536c0941a75d1bcf675bd966892c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2/2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71879,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_6d45a22c002b9325113c3605bc15e420.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2/2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69843,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_b3ba30f5e0fa8f3b720eace63bb8491a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2/2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62669,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_0caccf8cef672e58ef64c412580a519b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2/2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72470,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_23a2a5aabd6b4c4d7fedbc487037178f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2/2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69068,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_9d66bbcbe9610ca042a536bb9a51ea12.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2/2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72361,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_db36021a7ba628f407beeaeba567f483.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2/2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68688,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_cbdb8b7ef813c82d56f79c3d8c7fa529.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2/2f9b3cc5-9ab8-5528-a953-a6ca8b9808b2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64405,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/4b/054bf917f78bf0511dc67ea08b85545d/pa/EN63218_0d595bd816597e62b0928119f07b8f10.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-10-18',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Compass 1.6 M-Jet 80th Anniversary FWD',
'transmission': 'manual',
'trim': '80th Anniversary FWD',
'year': 2021}
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN63218%27 HTTP/1.1" 200 None
2026-03-28 21:08:01 [auto1.it] INFO: Saving data for EN63218: {'created_time': 1774732081.170161, 'last_price_update_time': 1774732081.170173, 'auction_closing_time': 1774886056.0}
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EN63218') HTTP/1.1" 204 0
2026-03-28 21:08:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ac3bd187-57e9-5a7c-8676-a49b3b640f7d with identifier: HY50986
2026-03-28 21:08:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ac3bd187-57e9-5a7c-8676-a49b3b640f7d with identifier: HY50986
2026-03-28 21:08:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ac3bd187-57e9-5a7c-8676-a49b3b640f7d with identifier: HY50986 to the API
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:08:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_dbae63849d05926f84750742bc843e22.jpg>
{'auction_title': '',
'c_o_2_emission_value': 207,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 3',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:27:11Z',
'fuel_type': 'petrol',
'id': 'ac3bd187-57e9-5a7c-8676-a49b3b640f7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY50986',
'listing': 'auction',
'location': 'IT, Aosta',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 165899,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3bd187-57e9-5a7c-8676-a49b3b640f7d/ac3bd187-57e9-5a7c-8676-a49b3b640f7d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68410,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_dbae63849d05926f84750742bc843e22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3bd187-57e9-5a7c-8676-a49b3b640f7d/ac3bd187-57e9-5a7c-8676-a49b3b640f7d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62473,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_12a9ecea4e53897326991e752f680962.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3bd187-57e9-5a7c-8676-a49b3b640f7d/ac3bd187-57e9-5a7c-8676-a49b3b640f7d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65617,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_f1cd617386d9cf335393b4cbb6798dbf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3bd187-57e9-5a7c-8676-a49b3b640f7d/ac3bd187-57e9-5a7c-8676-a49b3b640f7d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54973,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_97d820d2514f985d7d32ad319d5db0ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3bd187-57e9-5a7c-8676-a49b3b640f7d/ac3bd187-57e9-5a7c-8676-a49b3b640f7d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60771,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_b3475cc8f2dec8cd59cd82fc4a7659eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3bd187-57e9-5a7c-8676-a49b3b640f7d/ac3bd187-57e9-5a7c-8676-a49b3b640f7d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71792,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_bdb23d643bc49f04d287ccbe03114602.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3bd187-57e9-5a7c-8676-a49b3b640f7d/ac3bd187-57e9-5a7c-8676-a49b3b640f7d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52935,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_99181793b7a7e1dddc805980404b9110.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3bd187-57e9-5a7c-8676-a49b3b640f7d/ac3bd187-57e9-5a7c-8676-a49b3b640f7d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66317,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_26771fe107e159cef425cbf17bfff925.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3bd187-57e9-5a7c-8676-a49b3b640f7d/ac3bd187-57e9-5a7c-8676-a49b3b640f7d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59386,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_68bdc9d4753c3af02eb9ae00d76db5e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3bd187-57e9-5a7c-8676-a49b3b640f7d/ac3bd187-57e9-5a7c-8676-a49b3b640f7d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71457,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/f0/06f0ac739fac1e4992bade256a87617a/pa/HY50986_d2e3db582b11e002a6735b18e6267991.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2004-06-09',
'seats_number': 4,
'seller_name': None,
'title': 'Toyota RAV 4 2.0 4x4',
'transmission': 'manual',
'trim': '4x4',
'year': 2004}
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY50986%27 HTTP/1.1" 200 None
2026-03-28 21:08:01 [auto1.it] INFO: Saving data for HY50986: {'created_time': 1774732081.537747, 'last_price_update_time': 1774732081.53776, 'auction_closing_time': 1774884431.0}
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HY50986') HTTP/1.1" 204 0
2026-03-28 21:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_1696a5243c497ec8a0018ed0fe15042b.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_0271cc641920223dff1a18f5a4fc151d.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_c5c8819c9cbf4ab4a3936a6d60b65033.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_61a1779d7410ca90c899f6e680b40c2a.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_6b1c9065b15ad392ac97d173b5bd1baf.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_f01512169205e216a7c307f5f564f08c.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7eead0d0>
2026-03-28 21:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c050adfd-2e5f-57fc-84b0-cfdc5d69333e/c050adfd-2e5f-57fc-84b0-cfdc5d69333e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F20%252Fb2201e7086e1733f795da7b4ad698431%252Fpa%252FRN27083_a2698b204b3615c2698e46ae4b214e24.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_a2698b204b3615c2698e46ae4b214e24.jpg saved to cache
2026-03-28 21:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c050adfd-2e5f-57fc-84b0-cfdc5d69333e
2026-03-28 21:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7f745810>
2026-03-28 21:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_635da28b-5aac-5a71-be90-9c51a7875148/635da28b-5aac-5a71-be90-9c51a7875148_image_4.jpg HTTP/1.1" 201 0
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5c%252F8b5cdf0982d8bd309ac826979d4d9f51%252Fpa%252FXP44684_d53729edac5881f08fa3a29847fa21de.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_d53729edac5881f08fa3a29847fa21de.jpg saved to cache
2026-03-28 21:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 635da28b-5aac-5a71-be90-9c51a7875148
2026-03-28 21:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b840b9010>
2026-03-28 21:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bc4af0b-876b-5cba-9ed6-488e968d3fa6/9bc4af0b-876b-5cba-9ed6-488e968d3fa6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe8%252Fdee8342751f21c9bf5748e438fa52004%252Fpa%252FYX84472_5a469d72b21c4d8d1235ebbdd1e3ac40.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_5a469d72b21c4d8d1235ebbdd1e3ac40.jpg saved to cache
2026-03-28 21:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9bc4af0b-876b-5cba-9ed6-488e968d3fa6
2026-03-28 21:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7ed1bad0>
2026-03-28 21:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_635da28b-5aac-5a71-be90-9c51a7875148/635da28b-5aac-5a71-be90-9c51a7875148_image_3.jpg HTTP/1.1" 201 0
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5c%252F8b5cdf0982d8bd309ac826979d4d9f51%252Fpa%252FXP44684_d27521567566c9b48c21be9daaffb234.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_d27521567566c9b48c21be9daaffb234.jpg saved to cache
2026-03-28 21:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 635da28b-5aac-5a71-be90-9c51a7875148
2026-03-28 21:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7f745a50>
2026-03-28 21:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fb5%252Fe6b54352017b7f12d635372a3b22d354%252Fpa%252FPV47203_83f1c1f0af61cbfbd5da543b587fc5ec.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_83f1c1f0af61cbfbd5da543b587fc5ec.jpg saved to cache
2026-03-28 21:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3
2026-03-28 21:08:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3, skipping ID generation
2026-03-28 21:08:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3 with scrape type 1
2026-03-28 21:08:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3 sending to next pipeline
2026-03-28 21:08:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3, identifier: PV47203
2026-03-28 21:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b85be6510>
2026-03-28 21:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e74903cd-d235-51ba-b19c-bf3c49438536/e74903cd-d235-51ba-b19c-bf3c49438536_image_0.jpg HTTP/1.1" 201 0
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252Fcb%252Fc5cb63035dfc95f130df16b86544c163%252Fpa%252FTT70902_048ed1e759a79034726e16c5af290fa3.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_048ed1e759a79034726e16c5af290fa3.jpg saved to cache
2026-03-28 21:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e74903cd-d235-51ba-b19c-bf3c49438536
2026-03-28 21:08:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e74903cd-d235-51ba-b19c-bf3c49438536, skipping ID generation
2026-03-28 21:08:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e74903cd-d235-51ba-b19c-bf3c49438536 with scrape type 1
2026-03-28 21:08:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e74903cd-d235-51ba-b19c-bf3c49438536 sending to next pipeline
2026-03-28 21:08:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e74903cd-d235-51ba-b19c-bf3c49438536, identifier: TT70902
2026-03-28 21:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7ee9ffd0>
2026-03-28 21:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c050adfd-2e5f-57fc-84b0-cfdc5d69333e/c050adfd-2e5f-57fc-84b0-cfdc5d69333e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 21:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F20%252Fb2201e7086e1733f795da7b4ad698431%252Fpa%252FRN27083_e28cc829f6f5b0ac0d2a7413dbd7ad79.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_e28cc829f6f5b0ac0d2a7413dbd7ad79.jpg saved to cache
2026-03-28 21:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c050adfd-2e5f-57fc-84b0-cfdc5d69333e
2026-03-28 21:08:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3 with identifier: PV47203
2026-03-28 21:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3 with identifier: PV47203
2026-03-28 21:08:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3 with identifier: PV47203 to the API
2026-03-28 21:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:08:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:08:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_83f1c1f0af61cbfbd5da543b587fc5ec.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:33:58Z',
'fuel_type': 'petrol',
'id': '1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV47203',
'listing': 'auction',
'location': 'IT, San Giuliano Milanese',
'make': 'Volkswagen',
'model': 'Taigo',
'odometer': 14575,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83905,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_83f1c1f0af61cbfbd5da543b587fc5ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86794,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_a8a16a0869077d684990264d3aae48b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75936,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_085309c910f98069dd1ec7ccd3c86aa2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62782,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_12330d594426a0107ae0b516d5b434e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75895,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_e5ae8f9ffb2c789f60ffcba27dadaf40.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92719,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_dc8b573593518c594a8e1716e8857a11.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59776,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_720804120963bbd1c7e5023b3d64babd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90711,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_38344e1f17aae0ebdd9f4a30bcf8e463.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76432,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_91790f3254ff01747d01184dfb8273d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69336,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_4a75af54da2d5af8459b0c0e8cdec54d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-05-31',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Taigo 1.5 TSI ACT R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2023}
2026-03-28 21:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PV47203%27 HTTP/1.1" 200 None
2026-03-28 21:08:02 [auto1.it] INFO: Saving data for PV47203: {'created_time': 1774732082.419063, 'last_price_update_time': 1774732082.419075, 'auction_closing_time': 1774884838.0}
2026-03-28 21:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PV47203') HTTP/1.1" 204 0
2026-03-28 21:08:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e74903cd-d235-51ba-b19c-bf3c49438536 with identifier: TT70902
2026-03-28 21:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e74903cd-d235-51ba-b19c-bf3c49438536 with identifier: TT70902
2026-03-28 21:08:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e74903cd-d235-51ba-b19c-bf3c49438536 with identifier: TT70902 to the API
2026-03-28 21:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:08:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:08:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_048ed1e759a79034726e16c5af290fa3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 121,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:35:13Z',
'fuel_type': 'petrol',
'id': 'e74903cd-d235-51ba-b19c-bf3c49438536',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT70902',
'listing': 'auction',
'location': 'IT, Legnano',
'make': 'MINI',
'model': 'MINI',
'odometer': 92148,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e74903cd-d235-51ba-b19c-bf3c49438536/e74903cd-d235-51ba-b19c-bf3c49438536_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77874,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_048ed1e759a79034726e16c5af290fa3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e74903cd-d235-51ba-b19c-bf3c49438536/e74903cd-d235-51ba-b19c-bf3c49438536_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69076,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_e7da10fc5e114f62b8086cddb3a7e407.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e74903cd-d235-51ba-b19c-bf3c49438536/e74903cd-d235-51ba-b19c-bf3c49438536_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64486,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_82215026184121cd176042167e3074c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e74903cd-d235-51ba-b19c-bf3c49438536/e74903cd-d235-51ba-b19c-bf3c49438536_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49445,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_aa10e7843454d0e758acb974b2809af8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e74903cd-d235-51ba-b19c-bf3c49438536/e74903cd-d235-51ba-b19c-bf3c49438536_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60927,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_d561f97cd24593f9d570c5c8faa0c377.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e74903cd-d235-51ba-b19c-bf3c49438536/e74903cd-d235-51ba-b19c-bf3c49438536_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62659,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_7e2701fab7e0817d9d082db0ae0db411.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e74903cd-d235-51ba-b19c-bf3c49438536/e74903cd-d235-51ba-b19c-bf3c49438536_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47648,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_98dc8a19de6a73656d2b94e65c9d6c39.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e74903cd-d235-51ba-b19c-bf3c49438536/e74903cd-d235-51ba-b19c-bf3c49438536_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90547,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_d206d8d114850b2b21c71d7c146e888f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e74903cd-d235-51ba-b19c-bf3c49438536/e74903cd-d235-51ba-b19c-bf3c49438536_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74372,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_d47b4eb0558dc9acfdd8a4b40acd8009.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e74903cd-d235-51ba-b19c-bf3c49438536/e74903cd-d235-51ba-b19c-bf3c49438536_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55752,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/cb/c5cb63035dfc95f130df16b86544c163/pa/TT70902_4511b6ed0cfb02c96950712c91337abc.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-12-29',
'seats_number': 4,
'seller_name': None,
'title': 'MINI One',
'transmission': 'manual',
'trim': '',
'year': 2011}
2026-03-28 21:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT70902%27 HTTP/1.1" 200 None
2026-03-28 21:08:02 [auto1.it] INFO: Saving data for TT70902: {'created_time': 1774732082.783043, 'last_price_update_time': 1774732082.783054, 'auction_closing_time': 1774884913.0}
2026-03-28 21:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TT70902') HTTP/1.1" 204 0
2026-03-28 21:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BH87833/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b840ba210>
2026-03-28 21:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c050adfd-2e5f-57fc-84b0-cfdc5d69333e/c050adfd-2e5f-57fc-84b0-cfdc5d69333e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 21:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F20%252Fb2201e7086e1733f795da7b4ad698431%252Fpa%252FRN27083_1696a5243c497ec8a0018ed0fe15042b.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_1696a5243c497ec8a0018ed0fe15042b.jpg saved to cache
2026-03-28 21:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c050adfd-2e5f-57fc-84b0-cfdc5d69333e
2026-03-28 21:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8415fcd0>
2026-03-28 21:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c050adfd-2e5f-57fc-84b0-cfdc5d69333e/c050adfd-2e5f-57fc-84b0-cfdc5d69333e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 21:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F20%252Fb2201e7086e1733f795da7b4ad698431%252Fpa%252FRN27083_0271cc641920223dff1a18f5a4fc151d.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_0271cc641920223dff1a18f5a4fc151d.jpg saved to cache
2026-03-28 21:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c050adfd-2e5f-57fc-84b0-cfdc5d69333e
2026-03-28 21:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84322a90>
2026-03-28 21:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_635da28b-5aac-5a71-be90-9c51a7875148/635da28b-5aac-5a71-be90-9c51a7875148_image_2.jpg HTTP/1.1" 201 0
2026-03-28 21:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F5c%252F8b5cdf0982d8bd309ac826979d4d9f51%252Fpa%252FXP44684_c5c8819c9cbf4ab4a3936a6d60b65033.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_c5c8819c9cbf4ab4a3936a6d60b65033.jpg saved to cache
2026-03-28 21:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 635da28b-5aac-5a71-be90-9c51a7875148
2026-03-28 21:08:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 635da28b-5aac-5a71-be90-9c51a7875148, skipping ID generation
2026-03-28 21:08:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 635da28b-5aac-5a71-be90-9c51a7875148 with scrape type 1
2026-03-28 21:08:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 635da28b-5aac-5a71-be90-9c51a7875148 sending to next pipeline
2026-03-28 21:08:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 635da28b-5aac-5a71-be90-9c51a7875148, identifier: XP44684
2026-03-28 21:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84296f10>
2026-03-28 21:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0501cad-3902-50d7-965a-215a7e41e9f2/f0501cad-3902-50d7-965a-215a7e41e9f2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 21:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F7b%252F497b3713317451f19a61afb2eabcc56d%252Fpa%252FNC22560_61a1779d7410ca90c899f6e680b40c2a.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_61a1779d7410ca90c899f6e680b40c2a.jpg saved to cache
2026-03-28 21:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f0501cad-3902-50d7-965a-215a7e41e9f2
2026-03-28 21:08:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f0501cad-3902-50d7-965a-215a7e41e9f2, skipping ID generation
2026-03-28 21:08:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0501cad-3902-50d7-965a-215a7e41e9f2 with scrape type 1
2026-03-28 21:08:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f0501cad-3902-50d7-965a-215a7e41e9f2 sending to next pipeline
2026-03-28 21:08:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f0501cad-3902-50d7-965a-215a7e41e9f2, identifier: NC22560
2026-03-28 21:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b841c3090>
2026-03-28 21:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bc4af0b-876b-5cba-9ed6-488e968d3fa6/9bc4af0b-876b-5cba-9ed6-488e968d3fa6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 21:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fe8%252Fdee8342751f21c9bf5748e438fa52004%252Fpa%252FYX84472_6b1c9065b15ad392ac97d173b5bd1baf.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_6b1c9065b15ad392ac97d173b5bd1baf.jpg saved to cache
2026-03-28 21:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9bc4af0b-876b-5cba-9ed6-488e968d3fa6
2026-03-28 21:08:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9bc4af0b-876b-5cba-9ed6-488e968d3fa6, skipping ID generation
2026-03-28 21:08:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bc4af0b-876b-5cba-9ed6-488e968d3fa6 with scrape type 1
2026-03-28 21:08:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9bc4af0b-876b-5cba-9ed6-488e968d3fa6 sending to next pipeline
2026-03-28 21:08:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9bc4af0b-876b-5cba-9ed6-488e968d3fa6, identifier: YX84472
2026-03-28 21:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8415e190>
2026-03-28 21:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c050adfd-2e5f-57fc-84b0-cfdc5d69333e/c050adfd-2e5f-57fc-84b0-cfdc5d69333e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 21:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F20%252Fb2201e7086e1733f795da7b4ad698431%252Fpa%252FRN27083_f01512169205e216a7c307f5f564f08c.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_f01512169205e216a7c307f5f564f08c.jpg saved to cache
2026-03-28 21:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c050adfd-2e5f-57fc-84b0-cfdc5d69333e
2026-03-28 21:08:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c050adfd-2e5f-57fc-84b0-cfdc5d69333e, skipping ID generation
2026-03-28 21:08:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c050adfd-2e5f-57fc-84b0-cfdc5d69333e with scrape type 1
2026-03-28 21:08:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c050adfd-2e5f-57fc-84b0-cfdc5d69333e sending to next pipeline
2026-03-28 21:08:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c050adfd-2e5f-57fc-84b0-cfdc5d69333e, identifier: RN27083
2026-03-28 21:08:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:08:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 635da28b-5aac-5a71-be90-9c51a7875148 with identifier: XP44684
2026-03-28 21:08:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 635da28b-5aac-5a71-be90-9c51a7875148 with identifier: XP44684
2026-03-28 21:08:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 635da28b-5aac-5a71-be90-9c51a7875148 with identifier: XP44684 to the API
2026-03-28 21:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:08:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:08:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_c5c8819c9cbf4ab4a3936a6d60b65033.jpg>
{'auction_title': '',
'c_o_2_emission_value': 94,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:20:10Z',
'fuel_type': 'diesel',
'id': '635da28b-5aac-5a71-be90-9c51a7875148',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP44684',
'listing': 'auction',
'location': 'IT, Torino',
'make': 'Volvo',
'model': 'V40',
'odometer': 136264,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_635da28b-5aac-5a71-be90-9c51a7875148/635da28b-5aac-5a71-be90-9c51a7875148_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74548,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_4ab80f427eee70f7e747589566aa45bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_635da28b-5aac-5a71-be90-9c51a7875148/635da28b-5aac-5a71-be90-9c51a7875148_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63496,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_7dfaeebf58682ca3efff52724807c9d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_635da28b-5aac-5a71-be90-9c51a7875148/635da28b-5aac-5a71-be90-9c51a7875148_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52500,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_c5c8819c9cbf4ab4a3936a6d60b65033.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_635da28b-5aac-5a71-be90-9c51a7875148/635da28b-5aac-5a71-be90-9c51a7875148_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51059,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_d27521567566c9b48c21be9daaffb234.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_635da28b-5aac-5a71-be90-9c51a7875148/635da28b-5aac-5a71-be90-9c51a7875148_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48652,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_d53729edac5881f08fa3a29847fa21de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_635da28b-5aac-5a71-be90-9c51a7875148/635da28b-5aac-5a71-be90-9c51a7875148_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62893,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_135df0a92ac5ccd15589d0e3c287c7d2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_635da28b-5aac-5a71-be90-9c51a7875148/635da28b-5aac-5a71-be90-9c51a7875148_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55532,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_688b9cb27568a78a6f16af9a129bf651.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_635da28b-5aac-5a71-be90-9c51a7875148/635da28b-5aac-5a71-be90-9c51a7875148_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69126,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_fc5ca513caaff60a30ac432b4a82771e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_635da28b-5aac-5a71-be90-9c51a7875148/635da28b-5aac-5a71-be90-9c51a7875148_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63753,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_ae489bcbe199c2442422c033a2539860.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_635da28b-5aac-5a71-be90-9c51a7875148/635da28b-5aac-5a71-be90-9c51a7875148_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60724,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8b/5c/8b5cdf0982d8bd309ac826979d4d9f51/pa/XP44684_095fcff36026c3f63e31eb829569d8fe.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-04-25',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo V40 2.0 D2 Kinetic',
'transmission': 'manual',
'trim': 'Kinetic',
'year': 2016}
2026-03-28 21:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP44684%27 HTTP/1.1" 200 None
2026-03-28 21:08:03 [auto1.it] INFO: Saving data for XP44684: {'created_time': 1774732083.80271, 'last_price_update_time': 1774732083.802721, 'auction_closing_time': 1774884010.0}
2026-03-28 21:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XP44684') HTTP/1.1" 204 0
2026-03-28 21:08:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f0501cad-3902-50d7-965a-215a7e41e9f2 with identifier: NC22560
2026-03-28 21:08:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f0501cad-3902-50d7-965a-215a7e41e9f2 with identifier: NC22560
2026-03-28 21:08:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f0501cad-3902-50d7-965a-215a7e41e9f2 with identifier: NC22560 to the API
2026-03-28 21:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:08:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:08:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_61a1779d7410ca90c899f6e680b40c2a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 85,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.5L',
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:57:08Z',
'fuel_type': 'diesel',
'id': 'f0501cad-3902-50d7-965a-215a7e41e9f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC22560',
'listing': 'auction',
'location': 'IT, Milano',
'make': 'Renault',
'model': 'Clio',
'odometer': 109949,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0501cad-3902-50d7-965a-215a7e41e9f2/f0501cad-3902-50d7-965a-215a7e41e9f2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68651,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_1e04e451afb7cb9f5c7e2c7f6ac69317.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0501cad-3902-50d7-965a-215a7e41e9f2/f0501cad-3902-50d7-965a-215a7e41e9f2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47270,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_903eb30e5b3cc10f9aae1b9c8d94954b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0501cad-3902-50d7-965a-215a7e41e9f2/f0501cad-3902-50d7-965a-215a7e41e9f2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61816,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_7fc803ebbe8b06231929818ae1641b74.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0501cad-3902-50d7-965a-215a7e41e9f2/f0501cad-3902-50d7-965a-215a7e41e9f2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50841,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_3b0f16923dd705d4a1bb19309ac2bbd0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0501cad-3902-50d7-965a-215a7e41e9f2/f0501cad-3902-50d7-965a-215a7e41e9f2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52655,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_44aac1c4c3a45ef9168d07e7d783c6fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0501cad-3902-50d7-965a-215a7e41e9f2/f0501cad-3902-50d7-965a-215a7e41e9f2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62845,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_61a1779d7410ca90c899f6e680b40c2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0501cad-3902-50d7-965a-215a7e41e9f2/f0501cad-3902-50d7-965a-215a7e41e9f2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43894,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_d8b6290ffcba83e37bde4738151d5c19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0501cad-3902-50d7-965a-215a7e41e9f2/f0501cad-3902-50d7-965a-215a7e41e9f2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50468,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_80a75a5fbbdca1ab30ce1c7e16c1bf09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0501cad-3902-50d7-965a-215a7e41e9f2/f0501cad-3902-50d7-965a-215a7e41e9f2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68362,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_0141af47aa3bf121d1c23de24026a9ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0501cad-3902-50d7-965a-215a7e41e9f2/f0501cad-3902-50d7-965a-215a7e41e9f2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45435,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/7b/497b3713317451f19a61afb2eabcc56d/pa/NC22560_b01dde6955815c690ea4f304881e8ac9.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-02-17',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Expression',
'transmission': 'manual',
'trim': 'Expression',
'year': 2016}
2026-03-28 21:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC22560%27 HTTP/1.1" 200 None
2026-03-28 21:08:04 [auto1.it] INFO: Saving data for NC22560: {'created_time': 1774732084.252462, 'last_price_update_time': 1774732084.252476, 'auction_closing_time': 1774886228.0}
2026-03-28 21:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NC22560') HTTP/1.1" 204 0
2026-03-28 21:08:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9bc4af0b-876b-5cba-9ed6-488e968d3fa6 with identifier: YX84472
2026-03-28 21:08:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9bc4af0b-876b-5cba-9ed6-488e968d3fa6 with identifier: YX84472
2026-03-28 21:08:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9bc4af0b-876b-5cba-9ed6-488e968d3fa6 with identifier: YX84472 to the API
2026-03-28 21:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:08:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:08:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_6b1c9065b15ad392ac97d173b5bd1baf.jpg>
{'auction_title': '',
'c_o_2_emission_value': 150,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.5L',
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:16:13Z',
'fuel_type': 'petrol',
'id': '9bc4af0b-876b-5cba-9ed6-488e968d3fa6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX84472',
'listing': 'auction',
'location': 'IT, Alessandria',
'make': 'Honda',
'model': 'HR-V',
'odometer': 46466,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc4af0b-876b-5cba-9ed6-488e968d3fa6/9bc4af0b-876b-5cba-9ed6-488e968d3fa6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70745,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_a5683c43584a9e8972431898d38b5b5d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc4af0b-876b-5cba-9ed6-488e968d3fa6/9bc4af0b-876b-5cba-9ed6-488e968d3fa6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73439,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_3606238e001e986491ea10180ed6f724.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc4af0b-876b-5cba-9ed6-488e968d3fa6/9bc4af0b-876b-5cba-9ed6-488e968d3fa6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68439,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_6b1c9065b15ad392ac97d173b5bd1baf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc4af0b-876b-5cba-9ed6-488e968d3fa6/9bc4af0b-876b-5cba-9ed6-488e968d3fa6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62482,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_506bb2751287c22a67e4cb871eed65f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc4af0b-876b-5cba-9ed6-488e968d3fa6/9bc4af0b-876b-5cba-9ed6-488e968d3fa6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60146,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_5a469d72b21c4d8d1235ebbdd1e3ac40.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc4af0b-876b-5cba-9ed6-488e968d3fa6/9bc4af0b-876b-5cba-9ed6-488e968d3fa6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63740,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_3c48745b9bf49074b63ece99298e5415.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc4af0b-876b-5cba-9ed6-488e968d3fa6/9bc4af0b-876b-5cba-9ed6-488e968d3fa6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55668,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_528927cb5b247d92bfd0a81e9ea173dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc4af0b-876b-5cba-9ed6-488e968d3fa6/9bc4af0b-876b-5cba-9ed6-488e968d3fa6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71110,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_3059034482eda4f6731eab75a601c8c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc4af0b-876b-5cba-9ed6-488e968d3fa6/9bc4af0b-876b-5cba-9ed6-488e968d3fa6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63208,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_e12840d1627d97a7d8b428dd8154a01f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bc4af0b-876b-5cba-9ed6-488e968d3fa6/9bc4af0b-876b-5cba-9ed6-488e968d3fa6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48203,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/e8/dee8342751f21c9bf5748e438fa52004/pa/YX84472_61e8490baecc60e242d0ba7180c48440.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-05-30',
'seats_number': 5,
'seller_name': None,
'title': 'Honda HR-V 1.5 i-VTEC Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2021}
2026-03-28 21:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX84472%27 HTTP/1.1" 200 None
2026-03-28 21:08:04 [auto1.it] INFO: Saving data for YX84472: {'created_time': 1774732084.637822, 'last_price_update_time': 1774732084.63784, 'auction_closing_time': 1774883773.0}
2026-03-28 21:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YX84472') HTTP/1.1" 204 0
2026-03-28 21:08:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c050adfd-2e5f-57fc-84b0-cfdc5d69333e with identifier: RN27083
2026-03-28 21:08:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c050adfd-2e5f-57fc-84b0-cfdc5d69333e with identifier: RN27083
2026-03-28 21:08:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c050adfd-2e5f-57fc-84b0-cfdc5d69333e with identifier: RN27083 to the API
2026-03-28 21:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:08:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:08:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_f01512169205e216a7c307f5f564f08c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 128,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.3L',
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:36:28Z',
'fuel_type': 'petrol',
'id': 'c050adfd-2e5f-57fc-84b0-cfdc5d69333e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN27083',
'listing': 'auction',
'location': 'IT, Garbagnate Milanese',
'make': 'Renault',
'model': 'Captur',
'odometer': 75968,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c050adfd-2e5f-57fc-84b0-cfdc5d69333e/c050adfd-2e5f-57fc-84b0-cfdc5d69333e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70102,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_bb643b42a37589a23dc3fa09941ee594.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c050adfd-2e5f-57fc-84b0-cfdc5d69333e/c050adfd-2e5f-57fc-84b0-cfdc5d69333e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67930,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_0290400b3f6f181a3e3f2c915d651642.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c050adfd-2e5f-57fc-84b0-cfdc5d69333e/c050adfd-2e5f-57fc-84b0-cfdc5d69333e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68347,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_3fdfce0a0179bf5fb623d1c3f9764d85.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c050adfd-2e5f-57fc-84b0-cfdc5d69333e/c050adfd-2e5f-57fc-84b0-cfdc5d69333e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55049,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_0271cc641920223dff1a18f5a4fc151d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c050adfd-2e5f-57fc-84b0-cfdc5d69333e/c050adfd-2e5f-57fc-84b0-cfdc5d69333e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62184,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_2753f70f2747d81e3f991cb664477c1c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c050adfd-2e5f-57fc-84b0-cfdc5d69333e/c050adfd-2e5f-57fc-84b0-cfdc5d69333e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70679,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_992a3715f8873c4973b4ec6d9da7d095.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c050adfd-2e5f-57fc-84b0-cfdc5d69333e/c050adfd-2e5f-57fc-84b0-cfdc5d69333e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61433,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_1696a5243c497ec8a0018ed0fe15042b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c050adfd-2e5f-57fc-84b0-cfdc5d69333e/c050adfd-2e5f-57fc-84b0-cfdc5d69333e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79373,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_f01512169205e216a7c307f5f564f08c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c050adfd-2e5f-57fc-84b0-cfdc5d69333e/c050adfd-2e5f-57fc-84b0-cfdc5d69333e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70108,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_e28cc829f6f5b0ac0d2a7413dbd7ad79.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c050adfd-2e5f-57fc-84b0-cfdc5d69333e/c050adfd-2e5f-57fc-84b0-cfdc5d69333e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75761,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/20/b2201e7086e1733f795da7b4ad698431/pa/RN27083_a2698b204b3615c2698e46ae4b214e24.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-26',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 1.3 TCe Sport Edition2',
'transmission': 'manual',
'trim': 'Sport Edition2',
'year': 2019}
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN27083%27 HTTP/1.1" 200 None
2026-03-28 21:08:05 [auto1.it] INFO: Saving data for RN27083: {'created_time': 1774732085.060536, 'last_price_update_time': 1774732085.060549, 'auction_closing_time': 1774884988.0}
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RN27083') HTTP/1.1" 204 0
2026-03-28 21:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PY38952> (referer: https://www.auto1.com/v1/car-details-view/PY38952/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SX65477> (referer: https://www.auto1.com/v1/car-details-view/SX65477/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SC57434> (referer: https://www.auto1.com/v1/car-details-view/SC57434/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK78904/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XS00387> (referer: https://www.auto1.com/v1/car-details-view/XS00387/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:08:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:08:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:08:05 [scrapy.extensions.logstats] INFO: Crawled 177 pages (at 77 pages/min), scraped 160 items (at 60 items/min)
2026-03-28 21:08:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 194MiB
2026-03-28 21:08:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76b8933c-5ba5-58cd-bbec-7564cbadcb31 with identifier: PY38952
2026-03-28 21:08:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76b8933c-5ba5-58cd-bbec-7564cbadcb31 with scrape type 1
2026-03-28 21:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 76b8933c-5ba5-58cd-bbec-7564cbadcb31
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2c%252F6e2c0aeac4a1e1e0a6400ff32903538c%252Fpa%252FPY38952_25d9860410ba7899ad84d1f29b147013.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_25d9860410ba7899ad84d1f29b147013.jpg not downloaded yet
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2c%252F6e2c0aeac4a1e1e0a6400ff32903538c%252Fpa%252FPY38952_bbf70fe922e27809ec99c2dca9c31727.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_bbf70fe922e27809ec99c2dca9c31727.jpg not downloaded yet
2026-03-28 21:08:05 [auto1.it] INFO: Channel: 24h | Page: 45 | totalHits: 2224 | hits on page: 40
2026-03-28 21:08:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4fc9be8-45fc-5fed-83d0-15905ecaecf7 with identifier: SX65477
2026-03-28 21:08:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4fc9be8-45fc-5fed-83d0-15905ecaecf7 with scrape type 1
2026-03-28 21:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e4fc9be8-45fc-5fed-83d0-15905ecaecf7
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F98%252F27980ef685316b748125730e5ff3fc9a%252Fpa%252FSX65477_9dd66dcb40dcfa38367d1464cdb6bd2b.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/98/27980ef685316b748125730e5ff3fc9a/pa/SX65477_9dd66dcb40dcfa38367d1464cdb6bd2b.jpg not downloaded yet
2026-03-28 21:08:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4522de97-e69e-5b01-a6cc-89f78af84f43 with identifier: SC57434
2026-03-28 21:08:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4522de97-e69e-5b01-a6cc-89f78af84f43 with scrape type 1
2026-03-28 21:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4522de97-e69e-5b01-a6cc-89f78af84f43
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c105db638f613d8980a9751de790484%252Fpa%252FSC57434_611541f01108881196667b9e6dff7525.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_611541f01108881196667b9e6dff7525.jpg already downloaded
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c105db638f613d8980a9751de790484%252Fpa%252FSC57434_179cca1f8fde6ad1576c40d3b31ab1fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_179cca1f8fde6ad1576c40d3b31ab1fb.jpg already downloaded
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c105db638f613d8980a9751de790484%252Fpa%252FSC57434_4d1168b4788ba69f9adb6929548f09c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_4d1168b4788ba69f9adb6929548f09c3.jpg already downloaded
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c105db638f613d8980a9751de790484%252Fpa%252FSC57434_c78b08dff1ad87db5041a6ebe8e605df.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_c78b08dff1ad87db5041a6ebe8e605df.jpg already downloaded
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c105db638f613d8980a9751de790484%252Fpa%252FSC57434_fe8f3c714e6c9b9335617b1b55272c90.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_fe8f3c714e6c9b9335617b1b55272c90.jpg already downloaded
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c105db638f613d8980a9751de790484%252Fpa%252FSC57434_a83cde8462d2991b062a42eafa27f32b.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_a83cde8462d2991b062a42eafa27f32b.jpg already downloaded
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c105db638f613d8980a9751de790484%252Fpa%252FSC57434_72d41657a5e6fa53b7deaef533b517cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_72d41657a5e6fa53b7deaef533b517cd.jpg already downloaded
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c105db638f613d8980a9751de790484%252Fpa%252FSC57434_e89397ecb58f959c1374a73fb5792194.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_e89397ecb58f959c1374a73fb5792194.jpg already downloaded
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c105db638f613d8980a9751de790484%252Fpa%252FSC57434_8c41905def9211cb858ec182d8a20504.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_8c41905def9211cb858ec182d8a20504.jpg already downloaded
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F10%252F3c105db638f613d8980a9751de790484%252Fpa%252FSC57434_13aef3b45fdc04670470b2ee6db1d379.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_13aef3b45fdc04670470b2ee6db1d379.jpg already downloaded
2026-03-28 21:08:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4522de97-e69e-5b01-a6cc-89f78af84f43, identifier: SC57434
2026-03-28 21:08:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4cc5329-c4af-5c50-bd2f-b4c6a589fd22 with identifier: XS00387
2026-03-28 21:08:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4cc5329-c4af-5c50-bd2f-b4c6a589fd22 with scrape type 1
2026-03-28 21:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f4cc5329-c4af-5c50-bd2f-b4c6a589fd22
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F82%252Ff082cb925ec9b7f85ce95d923cf8e0a6%252Fpa%252FXS00387_3f933cfd1e97e082a29b3f2a2591d9c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_3f933cfd1e97e082a29b3f2a2591d9c9.jpg already downloaded
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F82%252Ff082cb925ec9b7f85ce95d923cf8e0a6%252Fpa%252FXS00387_4d1daa350ab45fa3005af3c743a13b37.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_4d1daa350ab45fa3005af3c743a13b37.jpg already downloaded
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F82%252Ff082cb925ec9b7f85ce95d923cf8e0a6%252Fpa%252FXS00387_56020ac1098276d62948b3427bf4d9c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_56020ac1098276d62948b3427bf4d9c9.jpg already downloaded
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F82%252Ff082cb925ec9b7f85ce95d923cf8e0a6%252Fpa%252FXS00387_ef30bef29064f8a8d3c595283873ef97.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_ef30bef29064f8a8d3c595283873ef97.jpg already downloaded
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F82%252Ff082cb925ec9b7f85ce95d923cf8e0a6%252Fpa%252FXS00387_8c57ba3e0cd2605049cf9434e7dd2bc1.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_8c57ba3e0cd2605049cf9434e7dd2bc1.jpg already downloaded
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F82%252Ff082cb925ec9b7f85ce95d923cf8e0a6%252Fpa%252FXS00387_7d3dbfa622653a7f58887d2737a0f757.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_7d3dbfa622653a7f58887d2737a0f757.jpg already downloaded
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F82%252Ff082cb925ec9b7f85ce95d923cf8e0a6%252Fpa%252FXS00387_8f0c36e681d76a0be54baf91539bb088.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_8f0c36e681d76a0be54baf91539bb088.jpg already downloaded
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F82%252Ff082cb925ec9b7f85ce95d923cf8e0a6%252Fpa%252FXS00387_82a7e4b0f39b6b9c27fb247468406f95.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_82a7e4b0f39b6b9c27fb247468406f95.jpg already downloaded
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F82%252Ff082cb925ec9b7f85ce95d923cf8e0a6%252Fpa%252FXS00387_01d5ee3d4b01ada8797f3c73120be71d.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_01d5ee3d4b01ada8797f3c73120be71d.jpg already downloaded
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F82%252Ff082cb925ec9b7f85ce95d923cf8e0a6%252Fpa%252FXS00387_3552a8a006ee0115ab874b3a07f5d9a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_3552a8a006ee0115ab874b3a07f5d9a8.jpg already downloaded
2026-03-28 21:08:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f4cc5329-c4af-5c50-bd2f-b4c6a589fd22, identifier: XS00387
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2c%252F6e2c0aeac4a1e1e0a6400ff32903538c%252Fpa%252FPY38952_1013b5392ccf88e6a50cdbacb6cf1891.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_1013b5392ccf88e6a50cdbacb6cf1891.jpg not downloaded yet
2026-03-28 21:08:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4522de97-e69e-5b01-a6cc-89f78af84f43 with identifier: SC57434
2026-03-28 21:08:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4522de97-e69e-5b01-a6cc-89f78af84f43 with identifier: SC57434
2026-03-28 21:08:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4522de97-e69e-5b01-a6cc-89f78af84f43 with identifier: SC57434 to the API
2026-03-28 21:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:08:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SC57434>
{'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:47:26Z',
'fuel_type': 'diesel',
'id': '4522de97-e69e-5b01-a6cc-89f78af84f43',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC57434',
'listing': 'auction',
'location': 'IT',
'make': 'Audi',
'model': 'Q5',
'odometer': 266442,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 14,
'photo_urls': ['https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_611541f01108881196667b9e6dff7525.jpg',
'https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_179cca1f8fde6ad1576c40d3b31ab1fb.jpg',
'https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_4d1168b4788ba69f9adb6929548f09c3.jpg',
'https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_c78b08dff1ad87db5041a6ebe8e605df.jpg',
'https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_fe8f3c714e6c9b9335617b1b55272c90.jpg',
'https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_a83cde8462d2991b062a42eafa27f32b.jpg',
'https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_72d41657a5e6fa53b7deaef533b517cd.jpg',
'https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_e89397ecb58f959c1374a73fb5792194.jpg',
'https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_8c41905def9211cb858ec182d8a20504.jpg',
'https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_13aef3b45fdc04670470b2ee6db1d379.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4522de97-e69e-5b01-a6cc-89f78af84f43/4522de97-e69e-5b01-a6cc-89f78af84f43_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 155099,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_611541f01108881196667b9e6dff7525.jpg',
'Width': 771},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4522de97-e69e-5b01-a6cc-89f78af84f43/4522de97-e69e-5b01-a6cc-89f78af84f43_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5127710,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_179cca1f8fde6ad1576c40d3b31ab1fb.jpg',
'Width': 3885},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4522de97-e69e-5b01-a6cc-89f78af84f43/4522de97-e69e-5b01-a6cc-89f78af84f43_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 135557,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_4d1168b4788ba69f9adb6929548f09c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4522de97-e69e-5b01-a6cc-89f78af84f43/4522de97-e69e-5b01-a6cc-89f78af84f43_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3673089,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_c78b08dff1ad87db5041a6ebe8e605df.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4522de97-e69e-5b01-a6cc-89f78af84f43/4522de97-e69e-5b01-a6cc-89f78af84f43_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 124193,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_fe8f3c714e6c9b9335617b1b55272c90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4522de97-e69e-5b01-a6cc-89f78af84f43/4522de97-e69e-5b01-a6cc-89f78af84f43_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3858284,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_a83cde8462d2991b062a42eafa27f32b.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4522de97-e69e-5b01-a6cc-89f78af84f43/4522de97-e69e-5b01-a6cc-89f78af84f43_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 129193,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_72d41657a5e6fa53b7deaef533b517cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4522de97-e69e-5b01-a6cc-89f78af84f43/4522de97-e69e-5b01-a6cc-89f78af84f43_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3836505,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_e89397ecb58f959c1374a73fb5792194.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4522de97-e69e-5b01-a6cc-89f78af84f43/4522de97-e69e-5b01-a6cc-89f78af84f43_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84579,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_8c41905def9211cb858ec182d8a20504.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4522de97-e69e-5b01-a6cc-89f78af84f43/4522de97-e69e-5b01-a6cc-89f78af84f43_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3566286,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/img3c/10/3c105db638f613d8980a9751de790484/pa/SC57434_13aef3b45fdc04670470b2ee6db1d379.jpg',
'Width': 3901}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-03-21',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2017}
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC57434%27 HTTP/1.1" 200 None
2026-03-28 21:08:07 [auto1.it] INFO: Saving data for SC57434: {'created_time': 1774732087.134366, 'last_price_update_time': 1774732087.134375, 'auction_closing_time': 1774885646.0}
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SC57434') HTTP/1.1" 204 0
2026-03-28 21:08:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f4cc5329-c4af-5c50-bd2f-b4c6a589fd22 with identifier: XS00387
2026-03-28 21:08:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f4cc5329-c4af-5c50-bd2f-b4c6a589fd22 with identifier: XS00387
2026-03-28 21:08:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f4cc5329-c4af-5c50-bd2f-b4c6a589fd22 with identifier: XS00387 to the API
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:08:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XS00387>
{'auction_title': '',
'c_o_2_emission_value': 158,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.2L',
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:14:31Z',
'fuel_type': 'diesel',
'id': 'f4cc5329-c4af-5c50-bd2f-b4c6a589fd22',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS00387',
'listing': 'auction',
'location': 'IT, Capua',
'make': 'Land Rover',
'model': 'Freelander',
'odometer': 210959,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_3f933cfd1e97e082a29b3f2a2591d9c9.jpg',
'https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_4d1daa350ab45fa3005af3c743a13b37.jpg',
'https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_56020ac1098276d62948b3427bf4d9c9.jpg',
'https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_ef30bef29064f8a8d3c595283873ef97.jpg',
'https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_8c57ba3e0cd2605049cf9434e7dd2bc1.jpg',
'https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_7d3dbfa622653a7f58887d2737a0f757.jpg',
'https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_8f0c36e681d76a0be54baf91539bb088.jpg',
'https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_82a7e4b0f39b6b9c27fb247468406f95.jpg',
'https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_01d5ee3d4b01ada8797f3c73120be71d.jpg',
'https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_3552a8a006ee0115ab874b3a07f5d9a8.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4cc5329-c4af-5c50-bd2f-b4c6a589fd22/f4cc5329-c4af-5c50-bd2f-b4c6a589fd22_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78764,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_3f933cfd1e97e082a29b3f2a2591d9c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4cc5329-c4af-5c50-bd2f-b4c6a589fd22/f4cc5329-c4af-5c50-bd2f-b4c6a589fd22_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73033,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_4d1daa350ab45fa3005af3c743a13b37.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4cc5329-c4af-5c50-bd2f-b4c6a589fd22/f4cc5329-c4af-5c50-bd2f-b4c6a589fd22_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75377,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_56020ac1098276d62948b3427bf4d9c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4cc5329-c4af-5c50-bd2f-b4c6a589fd22/f4cc5329-c4af-5c50-bd2f-b4c6a589fd22_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72098,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_ef30bef29064f8a8d3c595283873ef97.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4cc5329-c4af-5c50-bd2f-b4c6a589fd22/f4cc5329-c4af-5c50-bd2f-b4c6a589fd22_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65608,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_8c57ba3e0cd2605049cf9434e7dd2bc1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4cc5329-c4af-5c50-bd2f-b4c6a589fd22/f4cc5329-c4af-5c50-bd2f-b4c6a589fd22_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75908,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_7d3dbfa622653a7f58887d2737a0f757.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4cc5329-c4af-5c50-bd2f-b4c6a589fd22/f4cc5329-c4af-5c50-bd2f-b4c6a589fd22_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68613,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_8f0c36e681d76a0be54baf91539bb088.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4cc5329-c4af-5c50-bd2f-b4c6a589fd22/f4cc5329-c4af-5c50-bd2f-b4c6a589fd22_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74133,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_82a7e4b0f39b6b9c27fb247468406f95.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4cc5329-c4af-5c50-bd2f-b4c6a589fd22/f4cc5329-c4af-5c50-bd2f-b4c6a589fd22_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73035,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_01d5ee3d4b01ada8797f3c73120be71d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4cc5329-c4af-5c50-bd2f-b4c6a589fd22/f4cc5329-c4af-5c50-bd2f-b4c6a589fd22_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73290,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/82/f082cb925ec9b7f85ce95d923cf8e0a6/pa/XS00387_3552a8a006ee0115ab874b3a07f5d9a8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-11-13',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Freelander 2.2 Td4 ED4 SE',
'transmission': 'manual',
'trim': 'ED4 SE',
'year': 2013}
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XS00387%27 HTTP/1.1" 200 None
2026-03-28 21:08:07 [auto1.it] INFO: Saving data for XS00387: {'created_time': 1774732087.48008, 'last_price_update_time': 1774732087.48009, 'auction_closing_time': 1774883671.0}
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XS00387') HTTP/1.1" 204 0
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: EC03156
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: PD98498
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD98498%27 HTTP/1.1" 200 None
2026-03-28 21:08:07 [auto1.it] INFO: Scrape type for PD98498: 0
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: HJ07688
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HJ07688%27 HTTP/1.1" 200 None
2026-03-28 21:08:07 [auto1.it] INFO: Scrape type for HJ07688: 0
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: FF80511
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: UB92069
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: GU46238
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU46238%27 HTTP/1.1" 200 None
2026-03-28 21:08:07 [auto1.it] INFO: Scrape type for GU46238: 0
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: GS36896
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GS36896%27 HTTP/1.1" 200 None
2026-03-28 21:08:07 [auto1.it] INFO: Scrape type for GS36896: 0
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: DK49031
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK49031%27 HTTP/1.1" 200 None
2026-03-28 21:08:07 [auto1.it] INFO: Scrape type for DK49031: 0
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: MN68562
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: UW74676
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW74676%27 HTTP/1.1" 200 None
2026-03-28 21:08:07 [auto1.it] INFO: Scrape type for UW74676: 0
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: RR38006
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: JZ66909
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: EW77307
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: HJ48011
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HJ48011%27 HTTP/1.1" 200 None
2026-03-28 21:08:07 [auto1.it] INFO: Scrape type for HJ48011: 0
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: PJ71432
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: HJ37635
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: UM30654
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: HY25299
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: RG33241
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: ZT77518
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT77518%27 HTTP/1.1" 200 None
2026-03-28 21:08:07 [auto1.it] INFO: Scrape type for ZT77518: 0
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: KS29368
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KS29368%27 HTTP/1.1" 200 None
2026-03-28 21:08:07 [auto1.it] INFO: Scrape type for KS29368: 0
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: XS70804
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: EL95895
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: XP33889
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP33889%27 HTTP/1.1" 200 None
2026-03-28 21:08:07 [auto1.it] INFO: Scrape type for XP33889: 0
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: BS70853
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS70853%27 HTTP/1.1" 200 None
2026-03-28 21:08:07 [auto1.it] INFO: Scrape type for BS70853: 0
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: PP81137
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP81137%27 HTTP/1.1" 200 None
2026-03-28 21:08:07 [auto1.it] INFO: Scrape type for PP81137: 0
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: AB11915
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: YT31818
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: LK77946
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LK77946%27 HTTP/1.1" 200 None
2026-03-28 21:08:07 [auto1.it] INFO: Scrape type for LK77946: 0
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: CV06620
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV06620%27 HTTP/1.1" 200 None
2026-03-28 21:08:07 [auto1.it] INFO: Scrape type for CV06620: 0
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: CP91888
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: AT88859
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: WR49596
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: UT72595
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: WU25072
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU25072%27 HTTP/1.1" 200 None
2026-03-28 21:08:07 [auto1.it] INFO: Scrape type for WU25072: 0
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: XP46027
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP46027%27 HTTP/1.1" 200 None
2026-03-28 21:08:07 [auto1.it] INFO: Scrape type for XP46027: 0
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: ZS74487
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS74487%27 HTTP/1.1" 200 None
2026-03-28 21:08:07 [auto1.it] INFO: Scrape type for ZS74487: 0
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: FP84024
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP84024%27 HTTP/1.1" 200 None
2026-03-28 21:08:07 [auto1.it] INFO: Scrape type for FP84024: 0
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: HA91371
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA91371%27 HTTP/1.1" 200 None
2026-03-28 21:08:07 [auto1.it] INFO: Scrape type for HA91371: 0
2026-03-28 21:08:07 [auto1.it] INFO: Found listing with ID: ZT94310
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT94310%27 HTTP/1.1" 200 None
2026-03-28 21:08:07 [auto1.it] INFO: Scrape type for ZT94310: 0
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F98%252F27980ef685316b748125730e5ff3fc9a%252Fpa%252FSX65477_f538aff26e09c7007c8ac41cdfb6d52c.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/98/27980ef685316b748125730e5ff3fc9a/pa/SX65477_f538aff26e09c7007c8ac41cdfb6d52c.jpg not downloaded yet
2026-03-28 21:08:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:08:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2c%252F6e2c0aeac4a1e1e0a6400ff32903538c%252Fpa%252FPY38952_b3ad0f349e12d1b1f3805a01af22a413.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_b3ad0f349e12d1b1f3805a01af22a413.jpg not downloaded yet
2026-03-28 21:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TH60548> (referer: https://www.auto1.com/v1/car-details-view/TH60548/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F98%252F27980ef685316b748125730e5ff3fc9a%252Fpa%252FSX65477_42233c3842691deddd346e11d6a8c631.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/98/27980ef685316b748125730e5ff3fc9a/pa/SX65477_42233c3842691deddd346e11d6a8c631.jpg not downloaded yet
2026-03-28 21:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NF72135> (referer: https://www.auto1.com/v1/car-details-view/NF72135/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_25d9860410ba7899ad84d1f29b147013.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2c%252F6e2c0aeac4a1e1e0a6400ff32903538c%252Fpa%252FPY38952_db2d2b434e71cbeb2709f0eba4a4f0ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_db2d2b434e71cbeb2709f0eba4a4f0ee.jpg not downloaded yet
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F98%252F27980ef685316b748125730e5ff3fc9a%252Fpa%252FSX65477_3ff318bb618a0e9384aed2b5f15c35d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/98/27980ef685316b748125730e5ff3fc9a/pa/SX65477_3ff318bb618a0e9384aed2b5f15c35d4.jpg not downloaded yet
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2c%252F6e2c0aeac4a1e1e0a6400ff32903538c%252Fpa%252FPY38952_60a6b05537410c212f494797d1eaf6d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_60a6b05537410c212f494797d1eaf6d5.jpg not downloaded yet
2026-03-28 21:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F98%252F27980ef685316b748125730e5ff3fc9a%252Fpa%252FSX65477_8f367b0369837c98f9ba079b0096083e.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/98/27980ef685316b748125730e5ff3fc9a/pa/SX65477_8f367b0369837c98f9ba079b0096083e.jpg not downloaded yet
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2c%252F6e2c0aeac4a1e1e0a6400ff32903538c%252Fpa%252FPY38952_4fb6ed093f51ba5568249ccd723f3164.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_4fb6ed093f51ba5568249ccd723f3164.jpg not downloaded yet
2026-03-28 21:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/98/27980ef685316b748125730e5ff3fc9a/pa/SX65477_9dd66dcb40dcfa38367d1464cdb6bd2b.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2c%252F6e2c0aeac4a1e1e0a6400ff32903538c%252Fpa%252FPY38952_e82febe13b5096bf1bc7d8414aa27f7c.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_e82febe13b5096bf1bc7d8414aa27f7c.jpg not downloaded yet
2026-03-28 21:08:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 396cbf83-7fad-5380-88be-553f560d22a1 with identifier: TH60548
2026-03-28 21:08:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 396cbf83-7fad-5380-88be-553f560d22a1 with scrape type 1
2026-03-28 21:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 396cbf83-7fad-5380-88be-553f560d22a1
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fab%252F15ab47305766c894046513c4bb398db2%252Fpa%252FTH60548_1296cfa83dd0253fe37ba4acd38b571b.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_1296cfa83dd0253fe37ba4acd38b571b.jpg already downloaded
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fab%252F15ab47305766c894046513c4bb398db2%252Fpa%252FTH60548_8d7c6a5033c02bfb8d5c08cd1de17928.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_8d7c6a5033c02bfb8d5c08cd1de17928.jpg already downloaded
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fab%252F15ab47305766c894046513c4bb398db2%252Fpa%252FTH60548_2d8579e9013d9ab81dcab8a80a28c8e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_2d8579e9013d9ab81dcab8a80a28c8e3.jpg already downloaded
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fab%252F15ab47305766c894046513c4bb398db2%252Fpa%252FTH60548_94608f8f92e1e4fb7d66ff557eccb46f.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_94608f8f92e1e4fb7d66ff557eccb46f.jpg already downloaded
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fab%252F15ab47305766c894046513c4bb398db2%252Fpa%252FTH60548_b22469fd621f43a6953bb08cc249a209.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_b22469fd621f43a6953bb08cc249a209.jpg already downloaded
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fab%252F15ab47305766c894046513c4bb398db2%252Fpa%252FTH60548_1875139f06f24b0533d29f3067969c03.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_1875139f06f24b0533d29f3067969c03.jpg already downloaded
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fab%252F15ab47305766c894046513c4bb398db2%252Fpa%252FTH60548_800cf50d6f8ed8f4812de4611fda48d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_800cf50d6f8ed8f4812de4611fda48d9.jpg already downloaded
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fab%252F15ab47305766c894046513c4bb398db2%252Fpa%252FTH60548_f54c7b05fcd2c6fd6a2d46585b818e43.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_f54c7b05fcd2c6fd6a2d46585b818e43.jpg already downloaded
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fab%252F15ab47305766c894046513c4bb398db2%252Fpa%252FTH60548_2dcdcf034b563811d322dade7dc9994c.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_2dcdcf034b563811d322dade7dc9994c.jpg already downloaded
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252Fab%252F15ab47305766c894046513c4bb398db2%252Fpa%252FTH60548_b69a9c325e7a78599c4201cfc2f4b919.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_b69a9c325e7a78599c4201cfc2f4b919.jpg already downloaded
2026-03-28 21:08:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 396cbf83-7fad-5380-88be-553f560d22a1, identifier: TH60548
2026-03-28 21:08:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 396cbf83-7fad-5380-88be-553f560d22a1 with identifier: TH60548
2026-03-28 21:08:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 396cbf83-7fad-5380-88be-553f560d22a1 with identifier: TH60548
2026-03-28 21:08:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 396cbf83-7fad-5380-88be-553f560d22a1 with identifier: TH60548 to the API
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:08:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TH60548>
{'auction_title': '',
'c_o_2_emission_value': 143,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:31:00Z',
'fuel_type': 'petrol',
'id': '396cbf83-7fad-5380-88be-553f560d22a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH60548',
'listing': 'auction',
'location': 'IT',
'make': 'Opel',
'model': 'Meriva',
'odometer': 303119,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 13,
'photo_urls': ['https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_1296cfa83dd0253fe37ba4acd38b571b.jpg',
'https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_8d7c6a5033c02bfb8d5c08cd1de17928.jpg',
'https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_2d8579e9013d9ab81dcab8a80a28c8e3.jpg',
'https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_94608f8f92e1e4fb7d66ff557eccb46f.jpg',
'https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_b22469fd621f43a6953bb08cc249a209.jpg',
'https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_1875139f06f24b0533d29f3067969c03.jpg',
'https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_800cf50d6f8ed8f4812de4611fda48d9.jpg',
'https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_f54c7b05fcd2c6fd6a2d46585b818e43.jpg',
'https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_2dcdcf034b563811d322dade7dc9994c.jpg',
'https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_b69a9c325e7a78599c4201cfc2f4b919.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_396cbf83-7fad-5380-88be-553f560d22a1/396cbf83-7fad-5380-88be-553f560d22a1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4379526,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_1296cfa83dd0253fe37ba4acd38b571b.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_396cbf83-7fad-5380-88be-553f560d22a1/396cbf83-7fad-5380-88be-553f560d22a1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118970,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_8d7c6a5033c02bfb8d5c08cd1de17928.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_396cbf83-7fad-5380-88be-553f560d22a1/396cbf83-7fad-5380-88be-553f560d22a1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 138276,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_2d8579e9013d9ab81dcab8a80a28c8e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_396cbf83-7fad-5380-88be-553f560d22a1/396cbf83-7fad-5380-88be-553f560d22a1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 144464,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_94608f8f92e1e4fb7d66ff557eccb46f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_396cbf83-7fad-5380-88be-553f560d22a1/396cbf83-7fad-5380-88be-553f560d22a1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3026923,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_b22469fd621f43a6953bb08cc249a209.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_396cbf83-7fad-5380-88be-553f560d22a1/396cbf83-7fad-5380-88be-553f560d22a1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3895511,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_1875139f06f24b0533d29f3067969c03.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_396cbf83-7fad-5380-88be-553f560d22a1/396cbf83-7fad-5380-88be-553f560d22a1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102066,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_800cf50d6f8ed8f4812de4611fda48d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_396cbf83-7fad-5380-88be-553f560d22a1/396cbf83-7fad-5380-88be-553f560d22a1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139385,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_f54c7b05fcd2c6fd6a2d46585b818e43.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_396cbf83-7fad-5380-88be-553f560d22a1/396cbf83-7fad-5380-88be-553f560d22a1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3109983,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_2dcdcf034b563811d322dade7dc9994c.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_396cbf83-7fad-5380-88be-553f560d22a1/396cbf83-7fad-5380-88be-553f560d22a1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83566,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img15/ab/15ab47305766c894046513c4bb398db2/pa/TH60548_b69a9c325e7a78599c4201cfc2f4b919.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-03-21',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Meriva 1.4 Turbo Elective',
'transmission': 'manual',
'trim': 'Elective',
'year': 2012}
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH60548%27 HTTP/1.1" 200 None
2026-03-28 21:08:08 [auto1.it] INFO: Saving data for TH60548: {'created_time': 1774732088.688028, 'last_price_update_time': 1774732088.688038, 'auction_closing_time': 1774884660.0}
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TH60548') HTTP/1.1" 204 0
2026-03-28 21:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_bbf70fe922e27809ec99c2dca9c31727.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_db2d2b434e71cbeb2709f0eba4a4f0ee.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/98/27980ef685316b748125730e5ff3fc9a/pa/SX65477_3ff318bb618a0e9384aed2b5f15c35d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2c%252F6e2c0aeac4a1e1e0a6400ff32903538c%252Fpa%252FPY38952_325bfeceea9913eb33abfb4343f71b89.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_325bfeceea9913eb33abfb4343f71b89.jpg not downloaded yet
2026-03-28 21:08:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a03a23f-cb25-5166-872c-97f6d63a6808 with identifier: NF72135
2026-03-28 21:08:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a03a23f-cb25-5166-872c-97f6d63a6808 with scrape type 1
2026-03-28 21:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a03a23f-cb25-5166-872c-97f6d63a6808
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F66%252F2566d1a1c2f776deb93fb0a0270c8bce%252Fpa%252FNF72135_3e1fa1ce1a5eb1a53da0da97a69f1c7e.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_3e1fa1ce1a5eb1a53da0da97a69f1c7e.jpg already downloaded
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F66%252F2566d1a1c2f776deb93fb0a0270c8bce%252Fpa%252FNF72135_78179b8796d8ef1ea2c079468212affc.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_78179b8796d8ef1ea2c079468212affc.jpg already downloaded
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F66%252F2566d1a1c2f776deb93fb0a0270c8bce%252Fpa%252FNF72135_d8fdd8be02fce99f11a9df6a38757d88.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_d8fdd8be02fce99f11a9df6a38757d88.jpg already downloaded
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F66%252F2566d1a1c2f776deb93fb0a0270c8bce%252Fpa%252FNF72135_98383e702f3eb84806d0bfc7912a0e30.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_98383e702f3eb84806d0bfc7912a0e30.jpg already downloaded
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F66%252F2566d1a1c2f776deb93fb0a0270c8bce%252Fpa%252FNF72135_9ddb95616de854f252aba18f95b80d31.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_9ddb95616de854f252aba18f95b80d31.jpg already downloaded
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F66%252F2566d1a1c2f776deb93fb0a0270c8bce%252Fpa%252FNF72135_68111dbbc947144fa7436575aa817b2f.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_68111dbbc947144fa7436575aa817b2f.jpg already downloaded
2026-03-28 21:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F66%252F2566d1a1c2f776deb93fb0a0270c8bce%252Fpa%252FNF72135_6640b96e6274b565a680ed2ec9745910.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_6640b96e6274b565a680ed2ec9745910.jpg already downloaded
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F66%252F2566d1a1c2f776deb93fb0a0270c8bce%252Fpa%252FNF72135_a6f2ffcbe4ec40ad4081ce71c5399b9f.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_a6f2ffcbe4ec40ad4081ce71c5399b9f.jpg already downloaded
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F66%252F2566d1a1c2f776deb93fb0a0270c8bce%252Fpa%252FNF72135_e64d0b4aeabf19e468908f3d8ac1f84c.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_e64d0b4aeabf19e468908f3d8ac1f84c.jpg already downloaded
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F66%252F2566d1a1c2f776deb93fb0a0270c8bce%252Fpa%252FNF72135_ae878012f2f5637901b358670658f509.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_ae878012f2f5637901b358670658f509.jpg already downloaded
2026-03-28 21:08:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1a03a23f-cb25-5166-872c-97f6d63a6808, identifier: NF72135
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7eeb9e90>
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76b8933c-5ba5-58cd-bbec-7564cbadcb31/76b8933c-5ba5-58cd-bbec-7564cbadcb31_image_0.jpg HTTP/1.1" 201 0
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2c%252F6e2c0aeac4a1e1e0a6400ff32903538c%252Fpa%252FPY38952_25d9860410ba7899ad84d1f29b147013.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_25d9860410ba7899ad84d1f29b147013.jpg saved to cache
2026-03-28 21:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76b8933c-5ba5-58cd-bbec-7564cbadcb31
2026-03-28 21:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_1013b5392ccf88e6a50cdbacb6cf1891.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_b3ad0f349e12d1b1f3805a01af22a413.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/98/27980ef685316b748125730e5ff3fc9a/pa/SX65477_f538aff26e09c7007c8ac41cdfb6d52c.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/98/27980ef685316b748125730e5ff3fc9a/pa/SX65477_42233c3842691deddd346e11d6a8c631.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1a03a23f-cb25-5166-872c-97f6d63a6808 with identifier: NF72135
2026-03-28 21:08:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1a03a23f-cb25-5166-872c-97f6d63a6808 with identifier: NF72135
2026-03-28 21:08:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1a03a23f-cb25-5166-872c-97f6d63a6808 with identifier: NF72135 to the API
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:08:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NF72135>
{'auction_title': '',
'c_o_2_emission_value': 192,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 306,
'expiration_date': '2026-03-30T15:39:37Z',
'fuel_type': 'petrol',
'id': '1a03a23f-cb25-5166-872c-97f6d63a6808',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF72135',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 127345,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_3e1fa1ce1a5eb1a53da0da97a69f1c7e.jpg',
'https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_78179b8796d8ef1ea2c079468212affc.jpg',
'https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_d8fdd8be02fce99f11a9df6a38757d88.jpg',
'https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_98383e702f3eb84806d0bfc7912a0e30.jpg',
'https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_9ddb95616de854f252aba18f95b80d31.jpg',
'https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_68111dbbc947144fa7436575aa817b2f.jpg',
'https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_6640b96e6274b565a680ed2ec9745910.jpg',
'https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_a6f2ffcbe4ec40ad4081ce71c5399b9f.jpg',
'https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_e64d0b4aeabf19e468908f3d8ac1f84c.jpg',
'https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_ae878012f2f5637901b358670658f509.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a03a23f-cb25-5166-872c-97f6d63a6808/1a03a23f-cb25-5166-872c-97f6d63a6808_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2267656,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_3e1fa1ce1a5eb1a53da0da97a69f1c7e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a03a23f-cb25-5166-872c-97f6d63a6808/1a03a23f-cb25-5166-872c-97f6d63a6808_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58381,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_78179b8796d8ef1ea2c079468212affc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a03a23f-cb25-5166-872c-97f6d63a6808/1a03a23f-cb25-5166-872c-97f6d63a6808_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64344,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_d8fdd8be02fce99f11a9df6a38757d88.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a03a23f-cb25-5166-872c-97f6d63a6808/1a03a23f-cb25-5166-872c-97f6d63a6808_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2247655,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_98383e702f3eb84806d0bfc7912a0e30.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a03a23f-cb25-5166-872c-97f6d63a6808/1a03a23f-cb25-5166-872c-97f6d63a6808_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2406387,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_9ddb95616de854f252aba18f95b80d31.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a03a23f-cb25-5166-872c-97f6d63a6808/1a03a23f-cb25-5166-872c-97f6d63a6808_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2477555,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_68111dbbc947144fa7436575aa817b2f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a03a23f-cb25-5166-872c-97f6d63a6808/1a03a23f-cb25-5166-872c-97f6d63a6808_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2304134,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_6640b96e6274b565a680ed2ec9745910.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a03a23f-cb25-5166-872c-97f6d63a6808/1a03a23f-cb25-5166-872c-97f6d63a6808_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64155,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_a6f2ffcbe4ec40ad4081ce71c5399b9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a03a23f-cb25-5166-872c-97f6d63a6808/1a03a23f-cb25-5166-872c-97f6d63a6808_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2342193,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_e64d0b4aeabf19e468908f3d8ac1f84c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a03a23f-cb25-5166-872c-97f6d63a6808/1a03a23f-cb25-5166-872c-97f6d63a6808_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2706687,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img25/66/2566d1a1c2f776deb93fb0a0270c8bce/pa/NF72135_ae878012f2f5637901b358670658f509.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-08-02',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 35 AMG 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2021}
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF72135%27 HTTP/1.1" 200 None
2026-03-28 21:08:09 [auto1.it] INFO: Saving data for NF72135: {'created_time': 1774732089.519354, 'last_price_update_time': 1774732089.519366, 'auction_closing_time': 1774885177.0}
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NF72135') HTTP/1.1" 204 0
2026-03-28 21:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_60a6b05537410c212f494797d1eaf6d5.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2c%252F6e2c0aeac4a1e1e0a6400ff32903538c%252Fpa%252FPY38952_c03e643e172b5595eac6cf5f196bdbea.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_c03e643e172b5595eac6cf5f196bdbea.jpg not downloaded yet
2026-03-28 21:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BH87833> (referer: https://www.auto1.com/v1/car-details-view/BH87833/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YK98276/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_4fb6ed093f51ba5568249ccd723f3164.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/98/27980ef685316b748125730e5ff3fc9a/pa/SX65477_8f367b0369837c98f9ba079b0096083e.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8428c9d0>
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4fc9be8-45fc-5fed-83d0-15905ecaecf7/e4fc9be8-45fc-5fed-83d0-15905ecaecf7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F98%252F27980ef685316b748125730e5ff3fc9a%252Fpa%252FSX65477_9dd66dcb40dcfa38367d1464cdb6bd2b.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/98/27980ef685316b748125730e5ff3fc9a/pa/SX65477_9dd66dcb40dcfa38367d1464cdb6bd2b.jpg saved to cache
2026-03-28 21:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4fc9be8-45fc-5fed-83d0-15905ecaecf7
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7ee58c10>
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76b8933c-5ba5-58cd-bbec-7564cbadcb31/76b8933c-5ba5-58cd-bbec-7564cbadcb31_image_1.jpg HTTP/1.1" 201 0
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2c%252F6e2c0aeac4a1e1e0a6400ff32903538c%252Fpa%252FPY38952_bbf70fe922e27809ec99c2dca9c31727.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_bbf70fe922e27809ec99c2dca9c31727.jpg saved to cache
2026-03-28 21:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 76b8933c-5ba5-58cd-bbec-7564cbadcb31
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7ee86690>
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76b8933c-5ba5-58cd-bbec-7564cbadcb31/76b8933c-5ba5-58cd-bbec-7564cbadcb31_image_4.jpg HTTP/1.1" 201 0
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2c%252F6e2c0aeac4a1e1e0a6400ff32903538c%252Fpa%252FPY38952_db2d2b434e71cbeb2709f0eba4a4f0ee.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_db2d2b434e71cbeb2709f0eba4a4f0ee.jpg saved to cache
2026-03-28 21:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 76b8933c-5ba5-58cd-bbec-7564cbadcb31
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b861bcd10>
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4fc9be8-45fc-5fed-83d0-15905ecaecf7/e4fc9be8-45fc-5fed-83d0-15905ecaecf7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F98%252F27980ef685316b748125730e5ff3fc9a%252Fpa%252FSX65477_3ff318bb618a0e9384aed2b5f15c35d4.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/98/27980ef685316b748125730e5ff3fc9a/pa/SX65477_3ff318bb618a0e9384aed2b5f15c35d4.jpg saved to cache
2026-03-28 21:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e4fc9be8-45fc-5fed-83d0-15905ecaecf7
2026-03-28 21:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_e82febe13b5096bf1bc7d8414aa27f7c.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84214b90>
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76b8933c-5ba5-58cd-bbec-7564cbadcb31/76b8933c-5ba5-58cd-bbec-7564cbadcb31_image_2.jpg HTTP/1.1" 201 0
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2c%252F6e2c0aeac4a1e1e0a6400ff32903538c%252Fpa%252FPY38952_1013b5392ccf88e6a50cdbacb6cf1891.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_1013b5392ccf88e6a50cdbacb6cf1891.jpg saved to cache
2026-03-28 21:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 76b8933c-5ba5-58cd-bbec-7564cbadcb31
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8411a650>
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76b8933c-5ba5-58cd-bbec-7564cbadcb31/76b8933c-5ba5-58cd-bbec-7564cbadcb31_image_3.jpg HTTP/1.1" 201 0
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2c%252F6e2c0aeac4a1e1e0a6400ff32903538c%252Fpa%252FPY38952_b3ad0f349e12d1b1f3805a01af22a413.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_b3ad0f349e12d1b1f3805a01af22a413.jpg saved to cache
2026-03-28 21:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 76b8933c-5ba5-58cd-bbec-7564cbadcb31
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84344fd0>
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4fc9be8-45fc-5fed-83d0-15905ecaecf7/e4fc9be8-45fc-5fed-83d0-15905ecaecf7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F98%252F27980ef685316b748125730e5ff3fc9a%252Fpa%252FSX65477_f538aff26e09c7007c8ac41cdfb6d52c.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/98/27980ef685316b748125730e5ff3fc9a/pa/SX65477_f538aff26e09c7007c8ac41cdfb6d52c.jpg saved to cache
2026-03-28 21:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e4fc9be8-45fc-5fed-83d0-15905ecaecf7
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b840ff250>
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4fc9be8-45fc-5fed-83d0-15905ecaecf7/e4fc9be8-45fc-5fed-83d0-15905ecaecf7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F98%252F27980ef685316b748125730e5ff3fc9a%252Fpa%252FSX65477_42233c3842691deddd346e11d6a8c631.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/98/27980ef685316b748125730e5ff3fc9a/pa/SX65477_42233c3842691deddd346e11d6a8c631.jpg saved to cache
2026-03-28 21:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e4fc9be8-45fc-5fed-83d0-15905ecaecf7
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84197cd0>
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76b8933c-5ba5-58cd-bbec-7564cbadcb31/76b8933c-5ba5-58cd-bbec-7564cbadcb31_image_5.jpg HTTP/1.1" 201 0
2026-03-28 21:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2c%252F6e2c0aeac4a1e1e0a6400ff32903538c%252Fpa%252FPY38952_60a6b05537410c212f494797d1eaf6d5.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_60a6b05537410c212f494797d1eaf6d5.jpg saved to cache
2026-03-28 21:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 76b8933c-5ba5-58cd-bbec-7564cbadcb31
2026-03-28 21:08:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e7b32a6-7a28-5313-b7bd-a2a35783ed8f with identifier: BH87833
2026-03-28 21:08:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e7b32a6-7a28-5313-b7bd-a2a35783ed8f with scrape type 1
2026-03-28 21:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0e7b32a6-7a28-5313-b7bd-a2a35783ed8f
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F75%252F2275e9d9cda28035479274069c8b564f%252Fpa%252FBH87833_bdfc0deb7f70f28084b8929a4f8325b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_bdfc0deb7f70f28084b8929a4f8325b6.jpg not downloaded yet
2026-03-28 21:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7ed19390>
2026-03-28 21:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76b8933c-5ba5-58cd-bbec-7564cbadcb31/76b8933c-5ba5-58cd-bbec-7564cbadcb31_image_6.jpg HTTP/1.1" 201 0
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2c%252F6e2c0aeac4a1e1e0a6400ff32903538c%252Fpa%252FPY38952_4fb6ed093f51ba5568249ccd723f3164.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_4fb6ed093f51ba5568249ccd723f3164.jpg saved to cache
2026-03-28 21:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 76b8933c-5ba5-58cd-bbec-7564cbadcb31
2026-03-28 21:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7f746390>
2026-03-28 21:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4fc9be8-45fc-5fed-83d0-15905ecaecf7/e4fc9be8-45fc-5fed-83d0-15905ecaecf7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F98%252F27980ef685316b748125730e5ff3fc9a%252Fpa%252FSX65477_8f367b0369837c98f9ba079b0096083e.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/98/27980ef685316b748125730e5ff3fc9a/pa/SX65477_8f367b0369837c98f9ba079b0096083e.jpg saved to cache
2026-03-28 21:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e4fc9be8-45fc-5fed-83d0-15905ecaecf7
2026-03-28 21:08:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4fc9be8-45fc-5fed-83d0-15905ecaecf7, skipping ID generation
2026-03-28 21:08:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4fc9be8-45fc-5fed-83d0-15905ecaecf7 with scrape type 1
2026-03-28 21:08:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4fc9be8-45fc-5fed-83d0-15905ecaecf7 sending to next pipeline
2026-03-28 21:08:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e4fc9be8-45fc-5fed-83d0-15905ecaecf7, identifier: SX65477
2026-03-28 21:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_325bfeceea9913eb33abfb4343f71b89.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e4fc9be8-45fc-5fed-83d0-15905ecaecf7 with identifier: SX65477
2026-03-28 21:08:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e4fc9be8-45fc-5fed-83d0-15905ecaecf7 with identifier: SX65477
2026-03-28 21:08:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e4fc9be8-45fc-5fed-83d0-15905ecaecf7 with identifier: SX65477 to the API
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:08:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img27/98/27980ef685316b748125730e5ff3fc9a/pa/SX65477_8f367b0369837c98f9ba079b0096083e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 155,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.4L',
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:18:39Z',
'fuel_type': 'petrol',
'id': 'e4fc9be8-45fc-5fed-83d0-15905ecaecf7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX65477',
'listing': 'auction',
'location': 'IT, Pordenone',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 228848,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4fc9be8-45fc-5fed-83d0-15905ecaecf7/e4fc9be8-45fc-5fed-83d0-15905ecaecf7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106276,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/98/27980ef685316b748125730e5ff3fc9a/pa/SX65477_9dd66dcb40dcfa38367d1464cdb6bd2b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4fc9be8-45fc-5fed-83d0-15905ecaecf7/e4fc9be8-45fc-5fed-83d0-15905ecaecf7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98766,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/98/27980ef685316b748125730e5ff3fc9a/pa/SX65477_f538aff26e09c7007c8ac41cdfb6d52c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4fc9be8-45fc-5fed-83d0-15905ecaecf7/e4fc9be8-45fc-5fed-83d0-15905ecaecf7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77763,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/98/27980ef685316b748125730e5ff3fc9a/pa/SX65477_42233c3842691deddd346e11d6a8c631.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4fc9be8-45fc-5fed-83d0-15905ecaecf7/e4fc9be8-45fc-5fed-83d0-15905ecaecf7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52986,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/98/27980ef685316b748125730e5ff3fc9a/pa/SX65477_3ff318bb618a0e9384aed2b5f15c35d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4fc9be8-45fc-5fed-83d0-15905ecaecf7/e4fc9be8-45fc-5fed-83d0-15905ecaecf7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54113,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/98/27980ef685316b748125730e5ff3fc9a/pa/SX65477_8f367b0369837c98f9ba079b0096083e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2008-03-31',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Fabia 1.4 Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2008}
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX65477%27 HTTP/1.1" 200 None
2026-03-28 21:08:10 [auto1.it] INFO: Saving data for SX65477: {'created_time': 1774732090.566606, 'last_price_update_time': 1774732090.566617, 'auction_closing_time': 1774883919.0}
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SX65477') HTTP/1.1" 204 0
2026-03-28 21:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_c03e643e172b5595eac6cf5f196bdbea.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F75%252F2275e9d9cda28035479274069c8b564f%252Fpa%252FBH87833_817599be4729c4560b7058f0f04331a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_817599be4729c4560b7058f0f04331a4.jpg not downloaded yet
2026-03-28 21:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:08:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84381250>
2026-03-28 21:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76b8933c-5ba5-58cd-bbec-7564cbadcb31/76b8933c-5ba5-58cd-bbec-7564cbadcb31_image_7.jpg HTTP/1.1" 201 0
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2c%252F6e2c0aeac4a1e1e0a6400ff32903538c%252Fpa%252FPY38952_e82febe13b5096bf1bc7d8414aa27f7c.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_e82febe13b5096bf1bc7d8414aa27f7c.jpg saved to cache
2026-03-28 21:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 76b8933c-5ba5-58cd-bbec-7564cbadcb31
2026-03-28 21:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK78904> (referer: https://www.auto1.com/v1/car-details-view/FK78904/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F75%252F2275e9d9cda28035479274069c8b564f%252Fpa%252FBH87833_871538d8fe6b33db283af8d817a8e92c.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_871538d8fe6b33db283af8d817a8e92c.jpg not downloaded yet
2026-03-28 21:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b85be0990>
2026-03-28 21:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76b8933c-5ba5-58cd-bbec-7564cbadcb31/76b8933c-5ba5-58cd-bbec-7564cbadcb31_image_8.jpg HTTP/1.1" 201 0
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2c%252F6e2c0aeac4a1e1e0a6400ff32903538c%252Fpa%252FPY38952_325bfeceea9913eb33abfb4343f71b89.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_325bfeceea9913eb33abfb4343f71b89.jpg saved to cache
2026-03-28 21:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 76b8933c-5ba5-58cd-bbec-7564cbadcb31
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F75%252F2275e9d9cda28035479274069c8b564f%252Fpa%252FBH87833_ed2319a1c0dcf86eb714461fe35f7203.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_ed2319a1c0dcf86eb714461fe35f7203.jpg not downloaded yet
2026-03-28 21:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7f765a50>
2026-03-28 21:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76b8933c-5ba5-58cd-bbec-7564cbadcb31/76b8933c-5ba5-58cd-bbec-7564cbadcb31_image_9.jpg HTTP/1.1" 201 0
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F2c%252F6e2c0aeac4a1e1e0a6400ff32903538c%252Fpa%252FPY38952_c03e643e172b5595eac6cf5f196bdbea.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_c03e643e172b5595eac6cf5f196bdbea.jpg saved to cache
2026-03-28 21:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 76b8933c-5ba5-58cd-bbec-7564cbadcb31
2026-03-28 21:08:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76b8933c-5ba5-58cd-bbec-7564cbadcb31, skipping ID generation
2026-03-28 21:08:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76b8933c-5ba5-58cd-bbec-7564cbadcb31 with scrape type 1
2026-03-28 21:08:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76b8933c-5ba5-58cd-bbec-7564cbadcb31 sending to next pipeline
2026-03-28 21:08:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 76b8933c-5ba5-58cd-bbec-7564cbadcb31, identifier: PY38952
2026-03-28 21:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_bdfc0deb7f70f28084b8929a4f8325b6.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F75%252F2275e9d9cda28035479274069c8b564f%252Fpa%252FBH87833_6c187e9f0bf6021f420dea64bea827c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_6c187e9f0bf6021f420dea64bea827c6.jpg not downloaded yet
2026-03-28 21:08:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 76b8933c-5ba5-58cd-bbec-7564cbadcb31 with identifier: PY38952
2026-03-28 21:08:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 76b8933c-5ba5-58cd-bbec-7564cbadcb31 with identifier: PY38952
2026-03-28 21:08:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 76b8933c-5ba5-58cd-bbec-7564cbadcb31 with identifier: PY38952 to the API
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:08:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_c03e643e172b5595eac6cf5f196bdbea.jpg>
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:37:43Z',
'fuel_type': 'diesel',
'id': '76b8933c-5ba5-58cd-bbec-7564cbadcb31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY38952',
'listing': 'auction',
'location': 'IT, Bergamo',
'make': 'Fiat',
'model': '500L',
'odometer': 111184,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76b8933c-5ba5-58cd-bbec-7564cbadcb31/76b8933c-5ba5-58cd-bbec-7564cbadcb31_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72195,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_25d9860410ba7899ad84d1f29b147013.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76b8933c-5ba5-58cd-bbec-7564cbadcb31/76b8933c-5ba5-58cd-bbec-7564cbadcb31_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60230,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_bbf70fe922e27809ec99c2dca9c31727.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76b8933c-5ba5-58cd-bbec-7564cbadcb31/76b8933c-5ba5-58cd-bbec-7564cbadcb31_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73664,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_1013b5392ccf88e6a50cdbacb6cf1891.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76b8933c-5ba5-58cd-bbec-7564cbadcb31/76b8933c-5ba5-58cd-bbec-7564cbadcb31_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66414,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_b3ad0f349e12d1b1f3805a01af22a413.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76b8933c-5ba5-58cd-bbec-7564cbadcb31/76b8933c-5ba5-58cd-bbec-7564cbadcb31_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58140,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_db2d2b434e71cbeb2709f0eba4a4f0ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76b8933c-5ba5-58cd-bbec-7564cbadcb31/76b8933c-5ba5-58cd-bbec-7564cbadcb31_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72767,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_60a6b05537410c212f494797d1eaf6d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76b8933c-5ba5-58cd-bbec-7564cbadcb31/76b8933c-5ba5-58cd-bbec-7564cbadcb31_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60818,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_4fb6ed093f51ba5568249ccd723f3164.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76b8933c-5ba5-58cd-bbec-7564cbadcb31/76b8933c-5ba5-58cd-bbec-7564cbadcb31_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55463,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_e82febe13b5096bf1bc7d8414aa27f7c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76b8933c-5ba5-58cd-bbec-7564cbadcb31/76b8933c-5ba5-58cd-bbec-7564cbadcb31_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64800,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_325bfeceea9913eb33abfb4343f71b89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76b8933c-5ba5-58cd-bbec-7564cbadcb31/76b8933c-5ba5-58cd-bbec-7564cbadcb31_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54154,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/2c/6e2c0aeac4a1e1e0a6400ff32903538c/pa/PY38952_c03e643e172b5595eac6cf5f196bdbea.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-20',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500L 1.6 JTDM Pop Star',
'transmission': 'manual',
'trim': 'Pop Star',
'year': 2017}
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY38952%27 HTTP/1.1" 200 None
2026-03-28 21:08:11 [auto1.it] INFO: Saving data for PY38952: {'created_time': 1774732091.351358, 'last_price_update_time': 1774732091.35137, 'auction_closing_time': 1774885063.0}
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PY38952') HTTP/1.1" 204 0
2026-03-28 21:08:11 [auto1.it] INFO: Channel: 24h | Page: 46 | totalHits: 2224 | hits on page: 40
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F75%252F2275e9d9cda28035479274069c8b564f%252Fpa%252FBH87833_2ecf41eadc17a5ef8c5ea2c0322e4a18.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_2ecf41eadc17a5ef8c5ea2c0322e4a18.jpg not downloaded yet
2026-03-28 21:08:11 [auto1.it] INFO: Found listing with ID: YB21046
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB21046%27 HTTP/1.1" 200 None
2026-03-28 21:08:11 [auto1.it] INFO: Scrape type for YB21046: 0
2026-03-28 21:08:11 [auto1.it] INFO: Found listing with ID: GY17675
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY17675%27 HTTP/1.1" 200 None
2026-03-28 21:08:11 [auto1.it] INFO: Scrape type for GY17675: 0
2026-03-28 21:08:11 [auto1.it] INFO: Found listing with ID: HR28952
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR28952%27 HTTP/1.1" 200 None
2026-03-28 21:08:11 [auto1.it] INFO: Scrape type for HR28952: 0
2026-03-28 21:08:11 [auto1.it] INFO: Found listing with ID: CL50179
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL50179%27 HTTP/1.1" 200 None
2026-03-28 21:08:11 [auto1.it] INFO: Scrape type for CL50179: 0
2026-03-28 21:08:11 [auto1.it] INFO: Found listing with ID: AV05178
2026-03-28 21:08:11 [auto1.it] INFO: Found listing with ID: ZS11268
2026-03-28 21:08:11 [auto1.it] INFO: Found listing with ID: MR54744
2026-03-28 21:08:11 [auto1.it] INFO: Found listing with ID: VD19319
2026-03-28 21:08:11 [auto1.it] INFO: Found listing with ID: VR66407
2026-03-28 21:08:11 [auto1.it] INFO: Found listing with ID: MH80667
2026-03-28 21:08:11 [auto1.it] INFO: Found listing with ID: SH27035
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SH27035%27 HTTP/1.1" 200 None
2026-03-28 21:08:11 [auto1.it] INFO: Scrape type for SH27035: 0
2026-03-28 21:08:11 [auto1.it] INFO: Found listing with ID: AT94230
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT94230%27 HTTP/1.1" 200 None
2026-03-28 21:08:11 [auto1.it] INFO: Scrape type for AT94230: 0
2026-03-28 21:08:11 [auto1.it] INFO: Found listing with ID: VZ01162
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ01162%27 HTTP/1.1" 200 None
2026-03-28 21:08:11 [auto1.it] INFO: Scrape type for VZ01162: 0
2026-03-28 21:08:11 [auto1.it] INFO: Found listing with ID: KL53293
2026-03-28 21:08:11 [auto1.it] INFO: Found listing with ID: PC10788
2026-03-28 21:08:11 [auto1.it] INFO: Found listing with ID: UK65211
2026-03-28 21:08:11 [auto1.it] INFO: Found listing with ID: JP68462
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP68462%27 HTTP/1.1" 200 None
2026-03-28 21:08:11 [auto1.it] INFO: Scrape type for JP68462: 0
2026-03-28 21:08:11 [auto1.it] INFO: Found listing with ID: PW02213
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW02213%27 HTTP/1.1" 200 None
2026-03-28 21:08:11 [auto1.it] INFO: Scrape type for PW02213: 0
2026-03-28 21:08:11 [auto1.it] INFO: Found listing with ID: HK83461
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK83461%27 HTTP/1.1" 200 None
2026-03-28 21:08:11 [auto1.it] INFO: Scrape type for HK83461: 2
2026-03-28 21:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2298dccd-60ef-51a4-9e5e-ee6660ece843 with identifier: HK83461
2026-03-28 21:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2298dccd-60ef-51a4-9e5e-ee6660ece843 with scrape type 2
2026-03-28 21:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2298dccd-60ef-51a4-9e5e-ee6660ece843 with scrape type 2
2026-03-28 21:08:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2298dccd-60ef-51a4-9e5e-ee6660ece843, identifier: HK83461
2026-03-28 21:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_817599be4729c4560b7058f0f04331a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_871538d8fe6b33db283af8d817a8e92c.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2298dccd-60ef-51a4-9e5e-ee6660ece843 with identifier: HK83461
2026-03-28 21:08:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2298dccd-60ef-51a4-9e5e-ee6660ece843 with identifier: HK83461
2026-03-28 21:08:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2298dccd-60ef-51a4-9e5e-ee6660ece843 with identifier: HK83461 to the API
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:08:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:08:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 220,
'expiration_date': '2026-03-30T15:06:16Z',
'fuel_type': 'hybrid',
'id': '2298dccd-60ef-51a4-9e5e-ee6660ece843',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK83461',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 61852,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-17',
'seller_name': None,
'title': 'BMW X1 xDrive 25e Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2021}
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HK83461%27 HTTP/1.1" 200 None
2026-03-28 21:08:12 [auto1.it] INFO: Saving data for HK83461: {'auction_closing_time': 1774883176.0, 'created_time': 1774354009.089834, 'last_price_update_time': 1774732092.021949}
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HK83461') HTTP/1.1" 204 0
2026-03-28 21:08:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:08:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdb507fd-9623-5e51-8fd1-a1e99fea8d77 with identifier: FK78904
2026-03-28 21:08:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdb507fd-9623-5e51-8fd1-a1e99fea8d77 with scrape type 1
2026-03-28 21:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fdb507fd-9623-5e51-8fd1-a1e99fea8d77
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F43%252F2d43db66e8a7d4adfc23f0f0220e2950%252Fpa%252FFK78904_afe427edc1f99c8a97a3e16d21013e6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_afe427edc1f99c8a97a3e16d21013e6a.jpg already downloaded
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F43%252F2d43db66e8a7d4adfc23f0f0220e2950%252Fpa%252FFK78904_959365941c69df8a15e258a30f6472bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_959365941c69df8a15e258a30f6472bd.jpg already downloaded
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F43%252F2d43db66e8a7d4adfc23f0f0220e2950%252Fpa%252FFK78904_a7d858edbd5e77029db0a9099b63cb36.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_a7d858edbd5e77029db0a9099b63cb36.jpg already downloaded
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F43%252F2d43db66e8a7d4adfc23f0f0220e2950%252Fpa%252FFK78904_41ee765981cb28d0b5a2411c0cc73a4a.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_41ee765981cb28d0b5a2411c0cc73a4a.jpg already downloaded
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F43%252F2d43db66e8a7d4adfc23f0f0220e2950%252Fpa%252FFK78904_774a690ae310d01d5ce8e3cd9a2387cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_774a690ae310d01d5ce8e3cd9a2387cd.jpg already downloaded
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F43%252F2d43db66e8a7d4adfc23f0f0220e2950%252Fpa%252FFK78904_d07fb9ac9c56498a1b7ea69a71dd867e.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_d07fb9ac9c56498a1b7ea69a71dd867e.jpg already downloaded
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F43%252F2d43db66e8a7d4adfc23f0f0220e2950%252Fpa%252FFK78904_e563bed7598b83b4ae60d12978d4343e.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_e563bed7598b83b4ae60d12978d4343e.jpg already downloaded
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F43%252F2d43db66e8a7d4adfc23f0f0220e2950%252Fpa%252FFK78904_a3739205072b484c055781759d9846e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_a3739205072b484c055781759d9846e0.jpg already downloaded
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F43%252F2d43db66e8a7d4adfc23f0f0220e2950%252Fpa%252FFK78904_30660fe5b2e38c73ee0fe8288cec9a29.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_30660fe5b2e38c73ee0fe8288cec9a29.jpg already downloaded
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F43%252F2d43db66e8a7d4adfc23f0f0220e2950%252Fpa%252FFK78904_1108474b18656fae2c21a83abd008b65.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_1108474b18656fae2c21a83abd008b65.jpg already downloaded
2026-03-28 21:08:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fdb507fd-9623-5e51-8fd1-a1e99fea8d77, identifier: FK78904
2026-03-28 21:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b841e8e50>
2026-03-28 21:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e7b32a6-7a28-5313-b7bd-a2a35783ed8f/0e7b32a6-7a28-5313-b7bd-a2a35783ed8f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F75%252F2275e9d9cda28035479274069c8b564f%252Fpa%252FBH87833_bdfc0deb7f70f28084b8929a4f8325b6.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_bdfc0deb7f70f28084b8929a4f8325b6.jpg saved to cache
2026-03-28 21:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e7b32a6-7a28-5313-b7bd-a2a35783ed8f
2026-03-28 21:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_ed2319a1c0dcf86eb714461fe35f7203.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F75%252F2275e9d9cda28035479274069c8b564f%252Fpa%252FBH87833_b7321367dab4a92f2ae76afc261e0b6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_b7321367dab4a92f2ae76afc261e0b6a.jpg not downloaded yet
2026-03-28 21:08:12 [auto1.it] INFO: Found listing with ID: YY73995
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY73995%27 HTTP/1.1" 200 None
2026-03-28 21:08:12 [auto1.it] INFO: Scrape type for YY73995: 0
2026-03-28 21:08:12 [auto1.it] INFO: Found listing with ID: SA64006
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA64006%27 HTTP/1.1" 200 None
2026-03-28 21:08:12 [auto1.it] INFO: Scrape type for SA64006: 0
2026-03-28 21:08:12 [auto1.it] INFO: Found listing with ID: CL59289
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL59289%27 HTTP/1.1" 200 None
2026-03-28 21:08:12 [auto1.it] INFO: Scrape type for CL59289: 0
2026-03-28 21:08:12 [auto1.it] INFO: Found listing with ID: MM92729
2026-03-28 21:08:12 [auto1.it] INFO: Found listing with ID: XG56779
2026-03-28 21:08:12 [auto1.it] INFO: Found listing with ID: PN94511
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN94511%27 HTTP/1.1" 200 None
2026-03-28 21:08:12 [auto1.it] INFO: Scrape type for PN94511: 0
2026-03-28 21:08:12 [auto1.it] INFO: Found listing with ID: SP64220
2026-03-28 21:08:12 [auto1.it] INFO: Found listing with ID: DC19091
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC19091%27 HTTP/1.1" 200 None
2026-03-28 21:08:12 [auto1.it] INFO: Scrape type for DC19091: 0
2026-03-28 21:08:12 [auto1.it] INFO: Found listing with ID: CE88334
2026-03-28 21:08:12 [auto1.it] INFO: Found listing with ID: FP92305
2026-03-28 21:08:12 [auto1.it] INFO: Found listing with ID: WH54274
2026-03-28 21:08:12 [auto1.it] INFO: Found listing with ID: YA71285
2026-03-28 21:08:12 [auto1.it] INFO: Found listing with ID: ZZ46220
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ46220%27 HTTP/1.1" 200 None
2026-03-28 21:08:12 [auto1.it] INFO: Scrape type for ZZ46220: 0
2026-03-28 21:08:12 [auto1.it] INFO: Found listing with ID: CW38322
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CW38322%27 HTTP/1.1" 200 None
2026-03-28 21:08:12 [auto1.it] INFO: Scrape type for CW38322: 0
2026-03-28 21:08:12 [auto1.it] INFO: Found listing with ID: LX63173
2026-03-28 21:08:12 [auto1.it] INFO: Found listing with ID: KV28875
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV28875%27 HTTP/1.1" 200 None
2026-03-28 21:08:12 [auto1.it] INFO: Scrape type for KV28875: 0
2026-03-28 21:08:12 [auto1.it] INFO: Found listing with ID: RA59977
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RA59977%27 HTTP/1.1" 200 None
2026-03-28 21:08:12 [auto1.it] INFO: Scrape type for RA59977: 0
2026-03-28 21:08:12 [auto1.it] INFO: Found listing with ID: NF25875
2026-03-28 21:08:12 [auto1.it] INFO: Found listing with ID: KZ65568
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ65568%27 HTTP/1.1" 200 None
2026-03-28 21:08:12 [auto1.it] INFO: Scrape type for KZ65568: 0
2026-03-28 21:08:12 [auto1.it] INFO: Found listing with ID: WJ04614
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WJ04614%27 HTTP/1.1" 200 None
2026-03-28 21:08:12 [auto1.it] INFO: Scrape type for WJ04614: 0
2026-03-28 21:08:12 [auto1.it] INFO: Found listing with ID: GJ44194
2026-03-28 21:08:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fdb507fd-9623-5e51-8fd1-a1e99fea8d77 with identifier: FK78904
2026-03-28 21:08:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fdb507fd-9623-5e51-8fd1-a1e99fea8d77 with identifier: FK78904
2026-03-28 21:08:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fdb507fd-9623-5e51-8fd1-a1e99fea8d77 with identifier: FK78904 to the API
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:08:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:08:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FK78904>
{'auction_title': '',
'c_o_2_emission_value': 26,
'category': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.6L',
'engine_horse_power': 224,
'expiration_date': '2026-03-30T15:51:42Z',
'fuel_type': 'hybrid',
'id': 'fdb507fd-9623-5e51-8fd1-a1e99fea8d77',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK78904',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'make': 'Peugeot',
'model': '308',
'odometer': 28547,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_afe427edc1f99c8a97a3e16d21013e6a.jpg',
'https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_959365941c69df8a15e258a30f6472bd.jpg',
'https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_a7d858edbd5e77029db0a9099b63cb36.jpg',
'https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_41ee765981cb28d0b5a2411c0cc73a4a.jpg',
'https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_774a690ae310d01d5ce8e3cd9a2387cd.jpg',
'https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_d07fb9ac9c56498a1b7ea69a71dd867e.jpg',
'https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_e563bed7598b83b4ae60d12978d4343e.jpg',
'https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_a3739205072b484c055781759d9846e0.jpg',
'https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_30660fe5b2e38c73ee0fe8288cec9a29.jpg',
'https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_1108474b18656fae2c21a83abd008b65.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdb507fd-9623-5e51-8fd1-a1e99fea8d77/fdb507fd-9623-5e51-8fd1-a1e99fea8d77_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69684,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_afe427edc1f99c8a97a3e16d21013e6a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdb507fd-9623-5e51-8fd1-a1e99fea8d77/fdb507fd-9623-5e51-8fd1-a1e99fea8d77_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68165,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_959365941c69df8a15e258a30f6472bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdb507fd-9623-5e51-8fd1-a1e99fea8d77/fdb507fd-9623-5e51-8fd1-a1e99fea8d77_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60414,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_a7d858edbd5e77029db0a9099b63cb36.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdb507fd-9623-5e51-8fd1-a1e99fea8d77/fdb507fd-9623-5e51-8fd1-a1e99fea8d77_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57656,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_41ee765981cb28d0b5a2411c0cc73a4a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdb507fd-9623-5e51-8fd1-a1e99fea8d77/fdb507fd-9623-5e51-8fd1-a1e99fea8d77_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61004,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_774a690ae310d01d5ce8e3cd9a2387cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdb507fd-9623-5e51-8fd1-a1e99fea8d77/fdb507fd-9623-5e51-8fd1-a1e99fea8d77_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2458871,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_d07fb9ac9c56498a1b7ea69a71dd867e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdb507fd-9623-5e51-8fd1-a1e99fea8d77/fdb507fd-9623-5e51-8fd1-a1e99fea8d77_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52215,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_e563bed7598b83b4ae60d12978d4343e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdb507fd-9623-5e51-8fd1-a1e99fea8d77/fdb507fd-9623-5e51-8fd1-a1e99fea8d77_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68791,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_a3739205072b484c055781759d9846e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdb507fd-9623-5e51-8fd1-a1e99fea8d77/fdb507fd-9623-5e51-8fd1-a1e99fea8d77_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71760,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_30660fe5b2e38c73ee0fe8288cec9a29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdb507fd-9623-5e51-8fd1-a1e99fea8d77/fdb507fd-9623-5e51-8fd1-a1e99fea8d77_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65112,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/43/2d43db66e8a7d4adfc23f0f0220e2950/pa/FK78904_1108474b18656fae2c21a83abd008b65.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-12-28',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.6 Hybrid GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2022}
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK78904%27 HTTP/1.1" 200 None
2026-03-28 21:08:13 [auto1.it] INFO: Saving data for FK78904: {'created_time': 1774732093.049401, 'last_price_update_time': 1774732093.049414, 'auction_closing_time': 1774885902.0}
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FK78904') HTTP/1.1" 204 0
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F75%252F2275e9d9cda28035479274069c8b564f%252Fpa%252FBH87833_513f2fc6f09148497c17d6a5be998988.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_513f2fc6f09148497c17d6a5be998988.jpg not downloaded yet
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b84126510>
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e7b32a6-7a28-5313-b7bd-a2a35783ed8f/0e7b32a6-7a28-5313-b7bd-a2a35783ed8f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F75%252F2275e9d9cda28035479274069c8b564f%252Fpa%252FBH87833_817599be4729c4560b7058f0f04331a4.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_817599be4729c4560b7058f0f04331a4.jpg saved to cache
2026-03-28 21:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0e7b32a6-7a28-5313-b7bd-a2a35783ed8f
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7f764c10>
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e7b32a6-7a28-5313-b7bd-a2a35783ed8f/0e7b32a6-7a28-5313-b7bd-a2a35783ed8f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F75%252F2275e9d9cda28035479274069c8b564f%252Fpa%252FBH87833_871538d8fe6b33db283af8d817a8e92c.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_871538d8fe6b33db283af8d817a8e92c.jpg saved to cache
2026-03-28 21:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0e7b32a6-7a28-5313-b7bd-a2a35783ed8f
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7ee3b750>
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e7b32a6-7a28-5313-b7bd-a2a35783ed8f/0e7b32a6-7a28-5313-b7bd-a2a35783ed8f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F75%252F2275e9d9cda28035479274069c8b564f%252Fpa%252FBH87833_ed2319a1c0dcf86eb714461fe35f7203.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_ed2319a1c0dcf86eb714461fe35f7203.jpg saved to cache
2026-03-28 21:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0e7b32a6-7a28-5313-b7bd-a2a35783ed8f
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F75%252F2275e9d9cda28035479274069c8b564f%252Fpa%252FBH87833_73a34300168326034259fa190be1a16a.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_73a34300168326034259fa190be1a16a.jpg not downloaded yet
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F75%252F2275e9d9cda28035479274069c8b564f%252Fpa%252FBH87833_43b5cf95b29e1189708fbcb10bc8fdc6.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_43b5cf95b29e1189708fbcb10bc8fdc6.jpg not downloaded yet
2026-03-28 21:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_2ecf41eadc17a5ef8c5ea2c0322e4a18.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_6c187e9f0bf6021f420dea64bea827c6.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7f757e10>
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e7b32a6-7a28-5313-b7bd-a2a35783ed8f/0e7b32a6-7a28-5313-b7bd-a2a35783ed8f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F75%252F2275e9d9cda28035479274069c8b564f%252Fpa%252FBH87833_2ecf41eadc17a5ef8c5ea2c0322e4a18.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_2ecf41eadc17a5ef8c5ea2c0322e4a18.jpg saved to cache
2026-03-28 21:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0e7b32a6-7a28-5313-b7bd-a2a35783ed8f
2026-03-28 21:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_b7321367dab4a92f2ae76afc261e0b6a.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7ee38710>
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e7b32a6-7a28-5313-b7bd-a2a35783ed8f/0e7b32a6-7a28-5313-b7bd-a2a35783ed8f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F75%252F2275e9d9cda28035479274069c8b564f%252Fpa%252FBH87833_6c187e9f0bf6021f420dea64bea827c6.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_6c187e9f0bf6021f420dea64bea827c6.jpg saved to cache
2026-03-28 21:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0e7b32a6-7a28-5313-b7bd-a2a35783ed8f
2026-03-28 21:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_513f2fc6f09148497c17d6a5be998988.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_43b5cf95b29e1189708fbcb10bc8fdc6.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_73a34300168326034259fa190be1a16a.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7eedfd90>
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e7b32a6-7a28-5313-b7bd-a2a35783ed8f/0e7b32a6-7a28-5313-b7bd-a2a35783ed8f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F75%252F2275e9d9cda28035479274069c8b564f%252Fpa%252FBH87833_b7321367dab4a92f2ae76afc261e0b6a.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_b7321367dab4a92f2ae76afc261e0b6a.jpg saved to cache
2026-03-28 21:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0e7b32a6-7a28-5313-b7bd-a2a35783ed8f
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7ee0b2d0>
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e7b32a6-7a28-5313-b7bd-a2a35783ed8f/0e7b32a6-7a28-5313-b7bd-a2a35783ed8f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F75%252F2275e9d9cda28035479274069c8b564f%252Fpa%252FBH87833_513f2fc6f09148497c17d6a5be998988.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_513f2fc6f09148497c17d6a5be998988.jpg saved to cache
2026-03-28 21:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0e7b32a6-7a28-5313-b7bd-a2a35783ed8f
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7f7de3d0>
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e7b32a6-7a28-5313-b7bd-a2a35783ed8f/0e7b32a6-7a28-5313-b7bd-a2a35783ed8f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F75%252F2275e9d9cda28035479274069c8b564f%252Fpa%252FBH87833_43b5cf95b29e1189708fbcb10bc8fdc6.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_43b5cf95b29e1189708fbcb10bc8fdc6.jpg saved to cache
2026-03-28 21:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0e7b32a6-7a28-5313-b7bd-a2a35783ed8f
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7f7c9390>
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e7b32a6-7a28-5313-b7bd-a2a35783ed8f/0e7b32a6-7a28-5313-b7bd-a2a35783ed8f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F75%252F2275e9d9cda28035479274069c8b564f%252Fpa%252FBH87833_73a34300168326034259fa190be1a16a.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_73a34300168326034259fa190be1a16a.jpg saved to cache
2026-03-28 21:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0e7b32a6-7a28-5313-b7bd-a2a35783ed8f
2026-03-28 21:08:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e7b32a6-7a28-5313-b7bd-a2a35783ed8f, skipping ID generation
2026-03-28 21:08:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e7b32a6-7a28-5313-b7bd-a2a35783ed8f with scrape type 1
2026-03-28 21:08:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e7b32a6-7a28-5313-b7bd-a2a35783ed8f sending to next pipeline
2026-03-28 21:08:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0e7b32a6-7a28-5313-b7bd-a2a35783ed8f, identifier: BH87833
2026-03-28 21:08:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0e7b32a6-7a28-5313-b7bd-a2a35783ed8f with identifier: BH87833
2026-03-28 21:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0e7b32a6-7a28-5313-b7bd-a2a35783ed8f with identifier: BH87833
2026-03-28 21:08:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0e7b32a6-7a28-5313-b7bd-a2a35783ed8f with identifier: BH87833 to the API
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:08:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_73a34300168326034259fa190be1a16a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 123,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:16:09Z',
'fuel_type': 'petrol',
'id': '0e7b32a6-7a28-5313-b7bd-a2a35783ed8f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH87833',
'listing': 'auction',
'location': 'IT, Catania',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 138235,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e7b32a6-7a28-5313-b7bd-a2a35783ed8f/0e7b32a6-7a28-5313-b7bd-a2a35783ed8f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81500,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_bdfc0deb7f70f28084b8929a4f8325b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e7b32a6-7a28-5313-b7bd-a2a35783ed8f/0e7b32a6-7a28-5313-b7bd-a2a35783ed8f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82557,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_817599be4729c4560b7058f0f04331a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e7b32a6-7a28-5313-b7bd-a2a35783ed8f/0e7b32a6-7a28-5313-b7bd-a2a35783ed8f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73233,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_871538d8fe6b33db283af8d817a8e92c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e7b32a6-7a28-5313-b7bd-a2a35783ed8f/0e7b32a6-7a28-5313-b7bd-a2a35783ed8f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63838,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_ed2319a1c0dcf86eb714461fe35f7203.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e7b32a6-7a28-5313-b7bd-a2a35783ed8f/0e7b32a6-7a28-5313-b7bd-a2a35783ed8f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65996,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_6c187e9f0bf6021f420dea64bea827c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e7b32a6-7a28-5313-b7bd-a2a35783ed8f/0e7b32a6-7a28-5313-b7bd-a2a35783ed8f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75251,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_2ecf41eadc17a5ef8c5ea2c0322e4a18.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e7b32a6-7a28-5313-b7bd-a2a35783ed8f/0e7b32a6-7a28-5313-b7bd-a2a35783ed8f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63600,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_b7321367dab4a92f2ae76afc261e0b6a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e7b32a6-7a28-5313-b7bd-a2a35783ed8f/0e7b32a6-7a28-5313-b7bd-a2a35783ed8f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82748,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_513f2fc6f09148497c17d6a5be998988.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e7b32a6-7a28-5313-b7bd-a2a35783ed8f/0e7b32a6-7a28-5313-b7bd-a2a35783ed8f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79130,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_73a34300168326034259fa190be1a16a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e7b32a6-7a28-5313-b7bd-a2a35783ed8f/0e7b32a6-7a28-5313-b7bd-a2a35783ed8f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87593,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/75/2275e9d9cda28035479274069c8b564f/pa/BH87833_43b5cf95b29e1189708fbcb10bc8fdc6.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-10-17',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2019}
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BH87833%27 HTTP/1.1" 200 None
2026-03-28 21:08:14 [auto1.it] INFO: Saving data for BH87833: {'created_time': 1774732094.266168, 'last_price_update_time': 1774732094.266181, 'auction_closing_time': 1774883769.0}
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BH87833') HTTP/1.1" 204 0
2026-03-28 21:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YK98276> (referer: https://www.auto1.com/v1/car-details-view/YK98276/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:08:14 [auto1.it] INFO: Channel: 24h | Page: 47 | totalHits: 2224 | hits on page: 40
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: JK37550
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK37550%27 HTTP/1.1" 200 None
2026-03-28 21:08:14 [auto1.it] INFO: Scrape type for JK37550: 0
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: ZJ54266
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZJ54266%27 HTTP/1.1" 200 None
2026-03-28 21:08:14 [auto1.it] INFO: Scrape type for ZJ54266: 0
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: TU97067
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU97067%27 HTTP/1.1" 200 None
2026-03-28 21:08:14 [auto1.it] INFO: Scrape type for TU97067: 0
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: NG25648
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: BR40244
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR40244%27 HTTP/1.1" 200 None
2026-03-28 21:08:14 [auto1.it] INFO: Scrape type for BR40244: 0
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: DN16039
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: AV77078
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: WA78117
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA78117%27 HTTP/1.1" 200 None
2026-03-28 21:08:14 [auto1.it] INFO: Scrape type for WA78117: 0
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: KJ64759
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: DV92182
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV92182%27 HTTP/1.1" 200 None
2026-03-28 21:08:14 [auto1.it] INFO: Scrape type for DV92182: 0
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: KS37590
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: SN56705
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SN56705%27 HTTP/1.1" 200 None
2026-03-28 21:08:14 [auto1.it] INFO: Scrape type for SN56705: 0
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: RK00703
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: KM72059
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: NL56799
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: CZ11346
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ11346%27 HTTP/1.1" 200 None
2026-03-28 21:08:14 [auto1.it] INFO: Scrape type for CZ11346: 0
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: ZV36877
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: AW40388
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW40388%27 HTTP/1.1" 200 None
2026-03-28 21:08:14 [auto1.it] INFO: Scrape type for AW40388: 0
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: UR17084
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: DE71304
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE71304%27 HTTP/1.1" 200 None
2026-03-28 21:08:14 [auto1.it] INFO: Scrape type for DE71304: 0
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: LA00570
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA00570%27 HTTP/1.1" 200 None
2026-03-28 21:08:14 [auto1.it] INFO: Scrape type for LA00570: 0
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: ST97650
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST97650%27 HTTP/1.1" 200 None
2026-03-28 21:08:14 [auto1.it] INFO: Scrape type for ST97650: 0
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: CD54959
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD54959%27 HTTP/1.1" 200 None
2026-03-28 21:08:14 [auto1.it] INFO: Scrape type for CD54959: 0
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: ZH08694
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZH08694%27 HTTP/1.1" 200 None
2026-03-28 21:08:14 [auto1.it] INFO: Scrape type for ZH08694: 0
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: WN91380
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: RT10721
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT10721%27 HTTP/1.1" 200 None
2026-03-28 21:08:14 [auto1.it] INFO: Scrape type for RT10721: 0
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: XL68174
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL68174%27 HTTP/1.1" 200 None
2026-03-28 21:08:14 [auto1.it] INFO: Scrape type for XL68174: 0
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: NR40821
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: NR41367
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: DS09954
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: EF37813
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: CJ77239
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CJ77239%27 HTTP/1.1" 200 None
2026-03-28 21:08:14 [auto1.it] INFO: Scrape type for CJ77239: 0
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: BT82313
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BT82313%27 HTTP/1.1" 200 None
2026-03-28 21:08:14 [auto1.it] INFO: Scrape type for BT82313: 0
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: MN04958
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: LR68259
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: WB58416
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB58416%27 HTTP/1.1" 200 None
2026-03-28 21:08:14 [auto1.it] INFO: Scrape type for WB58416: 0
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: CS61296
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CS61296%27 HTTP/1.1" 200 None
2026-03-28 21:08:14 [auto1.it] INFO: Scrape type for CS61296: 0
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: HA26837
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: DE59865
2026-03-28 21:08:14 [auto1.it] INFO: Found listing with ID: JE63706
2026-03-28 21:08:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:08:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebb808d0-d05c-58bd-b690-93953ade62d7 with identifier: YK98276
2026-03-28 21:08:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebb808d0-d05c-58bd-b690-93953ade62d7 with scrape type 1
2026-03-28 21:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item ebb808d0-d05c-58bd-b690-93953ade62d7
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb3%252F57b3c5e4d94ab22ad25191b7351a2229%252Fpa%252FYK98276_e3f9810a752b042da8a1b7377906262f.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b3/57b3c5e4d94ab22ad25191b7351a2229/pa/YK98276_e3f9810a752b042da8a1b7377906262f.jpg not downloaded yet
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb3%252F57b3c5e4d94ab22ad25191b7351a2229%252Fpa%252FYK98276_82b0f792f8ee9e0fcfc0288057ea0b4f.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b3/57b3c5e4d94ab22ad25191b7351a2229/pa/YK98276_82b0f792f8ee9e0fcfc0288057ea0b4f.jpg not downloaded yet
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb3%252F57b3c5e4d94ab22ad25191b7351a2229%252Fpa%252FYK98276_9b282f0f9e03aa38f4de597026367d27.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b3/57b3c5e4d94ab22ad25191b7351a2229/pa/YK98276_9b282f0f9e03aa38f4de597026367d27.jpg not downloaded yet
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb3%252F57b3c5e4d94ab22ad25191b7351a2229%252Fpa%252FYK98276_aea01dccda59bf117d685aaba2c45abb.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b3/57b3c5e4d94ab22ad25191b7351a2229/pa/YK98276_aea01dccda59bf117d685aaba2c45abb.jpg not downloaded yet
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb3%252F57b3c5e4d94ab22ad25191b7351a2229%252Fpa%252FYK98276_ea33c35e2744e76a02dd46f5bd3da017.jpg%27 HTTP/1.1" 200 None
2026-03-28 21:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b3/57b3c5e4d94ab22ad25191b7351a2229/pa/YK98276_ea33c35e2744e76a02dd46f5bd3da017.jpg not downloaded yet
2026-03-28 21:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/b3/57b3c5e4d94ab22ad25191b7351a2229/pa/YK98276_e3f9810a752b042da8a1b7377906262f.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b841246d0>
2026-03-28 21:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebb808d0-d05c-58bd-b690-93953ade62d7/ebb808d0-d05c-58bd-b690-93953ade62d7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 21:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb3%252F57b3c5e4d94ab22ad25191b7351a2229%252Fpa%252FYK98276_e3f9810a752b042da8a1b7377906262f.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b3/57b3c5e4d94ab22ad25191b7351a2229/pa/YK98276_e3f9810a752b042da8a1b7377906262f.jpg saved to cache
2026-03-28 21:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ebb808d0-d05c-58bd-b690-93953ade62d7
2026-03-28 21:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/b3/57b3c5e4d94ab22ad25191b7351a2229/pa/YK98276_9b282f0f9e03aa38f4de597026367d27.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/b3/57b3c5e4d94ab22ad25191b7351a2229/pa/YK98276_82b0f792f8ee9e0fcfc0288057ea0b4f.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/b3/57b3c5e4d94ab22ad25191b7351a2229/pa/YK98276_aea01dccda59bf117d685aaba2c45abb.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/b3/57b3c5e4d94ab22ad25191b7351a2229/pa/YK98276_ea33c35e2744e76a02dd46f5bd3da017.jpg> (referer: https://www.auto1.com/)
2026-03-28 21:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7eeacb50>
2026-03-28 21:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebb808d0-d05c-58bd-b690-93953ade62d7/ebb808d0-d05c-58bd-b690-93953ade62d7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 21:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb3%252F57b3c5e4d94ab22ad25191b7351a2229%252Fpa%252FYK98276_9b282f0f9e03aa38f4de597026367d27.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b3/57b3c5e4d94ab22ad25191b7351a2229/pa/YK98276_9b282f0f9e03aa38f4de597026367d27.jpg saved to cache
2026-03-28 21:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ebb808d0-d05c-58bd-b690-93953ade62d7
2026-03-28 21:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b8428fcd0>
2026-03-28 21:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebb808d0-d05c-58bd-b690-93953ade62d7/ebb808d0-d05c-58bd-b690-93953ade62d7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 21:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb3%252F57b3c5e4d94ab22ad25191b7351a2229%252Fpa%252FYK98276_82b0f792f8ee9e0fcfc0288057ea0b4f.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b3/57b3c5e4d94ab22ad25191b7351a2229/pa/YK98276_82b0f792f8ee9e0fcfc0288057ea0b4f.jpg saved to cache
2026-03-28 21:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ebb808d0-d05c-58bd-b690-93953ade62d7
2026-03-28 21:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b7eedfd50>
2026-03-28 21:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebb808d0-d05c-58bd-b690-93953ade62d7/ebb808d0-d05c-58bd-b690-93953ade62d7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 21:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb3%252F57b3c5e4d94ab22ad25191b7351a2229%252Fpa%252FYK98276_aea01dccda59bf117d685aaba2c45abb.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b3/57b3c5e4d94ab22ad25191b7351a2229/pa/YK98276_aea01dccda59bf117d685aaba2c45abb.jpg saved to cache
2026-03-28 21:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ebb808d0-d05c-58bd-b690-93953ade62d7
2026-03-28 21:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 21:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2b841e9410>
2026-03-28 21:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 21:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 21:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 21:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebb808d0-d05c-58bd-b690-93953ade62d7/ebb808d0-d05c-58bd-b690-93953ade62d7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 21:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fb3%252F57b3c5e4d94ab22ad25191b7351a2229%252Fpa%252FYK98276_ea33c35e2744e76a02dd46f5bd3da017.jpg') HTTP/1.1" 204 0
2026-03-28 21:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/b3/57b3c5e4d94ab22ad25191b7351a2229/pa/YK98276_ea33c35e2744e76a02dd46f5bd3da017.jpg saved to cache
2026-03-28 21:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ebb808d0-d05c-58bd-b690-93953ade62d7
2026-03-28 21:08:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ebb808d0-d05c-58bd-b690-93953ade62d7, skipping ID generation
2026-03-28 21:08:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebb808d0-d05c-58bd-b690-93953ade62d7 with scrape type 1
2026-03-28 21:08:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ebb808d0-d05c-58bd-b690-93953ade62d7 sending to next pipeline
2026-03-28 21:08:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ebb808d0-d05c-58bd-b690-93953ade62d7, identifier: YK98276
2026-03-28 21:08:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ebb808d0-d05c-58bd-b690-93953ade62d7 with identifier: YK98276
2026-03-28 21:08:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ebb808d0-d05c-58bd-b690-93953ade62d7 with identifier: YK98276
2026-03-28 21:08:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ebb808d0-d05c-58bd-b690-93953ade62d7 with identifier: YK98276 to the API
2026-03-28 21:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 21:08:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 21:08:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img57/b3/57b3c5e4d94ab22ad25191b7351a2229/pa/YK98276_ea33c35e2744e76a02dd46f5bd3da017.jpg>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:41:11Z',
'fuel_type': 'diesel',
'id': 'ebb808d0-d05c-58bd-b690-93953ade62d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK98276',
'listing': 'auction',
'location': 'IT, Navacchio',
'make': 'Fiat',
'model': 'Qubo',
'odometer': 238217,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebb808d0-d05c-58bd-b690-93953ade62d7/ebb808d0-d05c-58bd-b690-93953ade62d7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72535,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/b3/57b3c5e4d94ab22ad25191b7351a2229/pa/YK98276_e3f9810a752b042da8a1b7377906262f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebb808d0-d05c-58bd-b690-93953ade62d7/ebb808d0-d05c-58bd-b690-93953ade62d7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70124,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/b3/57b3c5e4d94ab22ad25191b7351a2229/pa/YK98276_82b0f792f8ee9e0fcfc0288057ea0b4f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebb808d0-d05c-58bd-b690-93953ade62d7/ebb808d0-d05c-58bd-b690-93953ade62d7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61082,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/b3/57b3c5e4d94ab22ad25191b7351a2229/pa/YK98276_9b282f0f9e03aa38f4de597026367d27.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebb808d0-d05c-58bd-b690-93953ade62d7/ebb808d0-d05c-58bd-b690-93953ade62d7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71301,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/b3/57b3c5e4d94ab22ad25191b7351a2229/pa/YK98276_aea01dccda59bf117d685aaba2c45abb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebb808d0-d05c-58bd-b690-93953ade62d7/ebb808d0-d05c-58bd-b690-93953ade62d7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72790,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/b3/57b3c5e4d94ab22ad25191b7351a2229/pa/YK98276_ea33c35e2744e76a02dd46f5bd3da017.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-12-20',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Qubo 1.3 JTD Dynamic',
'transmission': 'manual',
'trim': 'Dynamic',
'year': 2010}
2026-03-28 21:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YK98276%27 HTTP/1.1" 200 None
2026-03-28 21:08:15 [auto1.it] INFO: Saving data for YK98276: {'created_time': 1774732095.96733, 'last_price_update_time': 1774732095.96734, 'auction_closing_time': 1774885271.0}
2026-03-28 21:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YK98276') HTTP/1.1" 204 0
2026-03-28 21:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:08:16 [auto1.it] INFO: Channel: 24h | Page: 48 | totalHits: 2224 | hits on page: 40
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: CN51839
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: JR85955
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: MC18601
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: JH97185
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: SY20877
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: KT14926
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT14926%27 HTTP/1.1" 200 None
2026-03-28 21:08:16 [auto1.it] INFO: Scrape type for KT14926: 0
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: SD18580
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD18580%27 HTTP/1.1" 200 None
2026-03-28 21:08:16 [auto1.it] INFO: Scrape type for SD18580: 0
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: TW38851
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: RM24928
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RM24928%27 HTTP/1.1" 200 None
2026-03-28 21:08:16 [auto1.it] INFO: Scrape type for RM24928: 0
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: DF57379
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF57379%27 HTTP/1.1" 200 None
2026-03-28 21:08:16 [auto1.it] INFO: Scrape type for DF57379: 0
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: VG07643
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: XB46951
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: UN20093
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN20093%27 HTTP/1.1" 200 None
2026-03-28 21:08:16 [auto1.it] INFO: Scrape type for UN20093: 0
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: UT21803
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UT21803%27 HTTP/1.1" 200 None
2026-03-28 21:08:16 [auto1.it] INFO: Scrape type for UT21803: 0
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: YJ81563
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: RC42052
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC42052%27 HTTP/1.1" 200 None
2026-03-28 21:08:16 [auto1.it] INFO: Scrape type for RC42052: 0
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: JF24469
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: VZ90962
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: FR55532
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR55532%27 HTTP/1.1" 200 None
2026-03-28 21:08:16 [auto1.it] INFO: Scrape type for FR55532: 0
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: BL56378
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL56378%27 HTTP/1.1" 200 None
2026-03-28 21:08:16 [auto1.it] INFO: Scrape type for BL56378: 0
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: HF54587
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF54587%27 HTTP/1.1" 200 None
2026-03-28 21:08:16 [auto1.it] INFO: Scrape type for HF54587: 0
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: AY76833
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY76833%27 HTTP/1.1" 200 None
2026-03-28 21:08:16 [auto1.it] INFO: Scrape type for AY76833: 0
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: RJ05786
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: CV60870
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV60870%27 HTTP/1.1" 200 None
2026-03-28 21:08:16 [auto1.it] INFO: Scrape type for CV60870: 0
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: PM98470
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM98470%27 HTTP/1.1" 200 None
2026-03-28 21:08:16 [auto1.it] INFO: Scrape type for PM98470: 0
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: XT30792
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XT30792%27 HTTP/1.1" 200 None
2026-03-28 21:08:16 [auto1.it] INFO: Scrape type for XT30792: 0
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: HD11089
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: WM47642
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: KH13960
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: JU86722
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU86722%27 HTTP/1.1" 200 None
2026-03-28 21:08:16 [auto1.it] INFO: Scrape type for JU86722: 0
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: WS77593
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: KM48378
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM48378%27 HTTP/1.1" 200 None
2026-03-28 21:08:16 [auto1.it] INFO: Scrape type for KM48378: 0
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: ET22397
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET22397%27 HTTP/1.1" 200 None
2026-03-28 21:08:16 [auto1.it] INFO: Scrape type for ET22397: 0
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: ML76939
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: TB64568
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB64568%27 HTTP/1.1" 200 None
2026-03-28 21:08:16 [auto1.it] INFO: Scrape type for TB64568: 0
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: ZU99068
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU99068%27 HTTP/1.1" 200 None
2026-03-28 21:08:16 [auto1.it] INFO: Scrape type for ZU99068: 0
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: VL91397
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: WG77442
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: LE72169
2026-03-28 21:08:16 [auto1.it] INFO: Found listing with ID: UR17462
2026-03-28 21:08:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:08:17 [auto1.it] INFO: Channel: 24h | Page: 49 | totalHits: 2224 | hits on page: 40
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: DU34377
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU34377%27 HTTP/1.1" 200 None
2026-03-28 21:08:17 [auto1.it] INFO: Scrape type for DU34377: 0
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: EV59116
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: UY41081
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: VK68045
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK68045%27 HTTP/1.1" 200 None
2026-03-28 21:08:17 [auto1.it] INFO: Scrape type for VK68045: 0
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: YN18335
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: NA95464
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA95464%27 HTTP/1.1" 200 None
2026-03-28 21:08:17 [auto1.it] INFO: Scrape type for NA95464: 0
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: WA05506
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA05506%27 HTTP/1.1" 200 None
2026-03-28 21:08:17 [auto1.it] INFO: Scrape type for WA05506: 0
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: PW96424
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW96424%27 HTTP/1.1" 200 None
2026-03-28 21:08:17 [auto1.it] INFO: Scrape type for PW96424: 0
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: CZ80815
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: YT14499
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: BU30300
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: WE07120
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WE07120%27 HTTP/1.1" 200 None
2026-03-28 21:08:17 [auto1.it] INFO: Scrape type for WE07120: 0
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: NF75023
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: VZ92626
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VZ92626%27 HTTP/1.1" 200 None
2026-03-28 21:08:17 [auto1.it] INFO: Scrape type for VZ92626: 0
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: TF83722
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TF83722%27 HTTP/1.1" 200 None
2026-03-28 21:08:17 [auto1.it] INFO: Scrape type for TF83722: 0
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: BA01278
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA01278%27 HTTP/1.1" 200 None
2026-03-28 21:08:17 [auto1.it] INFO: Scrape type for BA01278: 0
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: PW47751
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW47751%27 HTTP/1.1" 200 None
2026-03-28 21:08:17 [auto1.it] INFO: Scrape type for PW47751: 0
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: CU74500
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU74500%27 HTTP/1.1" 200 None
2026-03-28 21:08:17 [auto1.it] INFO: Scrape type for CU74500: 0
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: SB06120
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB06120%27 HTTP/1.1" 200 None
2026-03-28 21:08:17 [auto1.it] INFO: Scrape type for SB06120: 0
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: VC50043
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: ZK25339
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK25339%27 HTTP/1.1" 200 None
2026-03-28 21:08:17 [auto1.it] INFO: Scrape type for ZK25339: 0
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: ZX07478
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: VY27693
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY27693%27 HTTP/1.1" 200 None
2026-03-28 21:08:17 [auto1.it] INFO: Scrape type for VY27693: 0
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: JZ77925
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JZ77925%27 HTTP/1.1" 200 None
2026-03-28 21:08:17 [auto1.it] INFO: Scrape type for JZ77925: 0
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: YY84618
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: LN66513
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN66513%27 HTTP/1.1" 200 None
2026-03-28 21:08:17 [auto1.it] INFO: Scrape type for LN66513: 0
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: CE47539
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE47539%27 HTTP/1.1" 200 None
2026-03-28 21:08:17 [auto1.it] INFO: Scrape type for CE47539: 0
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: ET05908
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET05908%27 HTTP/1.1" 200 None
2026-03-28 21:08:17 [auto1.it] INFO: Scrape type for ET05908: 0
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: YH77376
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: YF75384
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YF75384%27 HTTP/1.1" 200 None
2026-03-28 21:08:17 [auto1.it] INFO: Scrape type for YF75384: 0
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: YP53845
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP53845%27 HTTP/1.1" 200 None
2026-03-28 21:08:17 [auto1.it] INFO: Scrape type for YP53845: 0
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: MU44225
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: DV89996
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV89996%27 HTTP/1.1" 200 None
2026-03-28 21:08:17 [auto1.it] INFO: Scrape type for DV89996: 0
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: GC21308
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC21308%27 HTTP/1.1" 200 None
2026-03-28 21:08:17 [auto1.it] INFO: Scrape type for GC21308: 0
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: WN69179
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN69179%27 HTTP/1.1" 200 None
2026-03-28 21:08:17 [auto1.it] INFO: Scrape type for WN69179: 0
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: RT68139
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT68139%27 HTTP/1.1" 200 None
2026-03-28 21:08:17 [auto1.it] INFO: Scrape type for RT68139: 0
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: GU07540
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GU07540%27 HTTP/1.1" 200 None
2026-03-28 21:08:17 [auto1.it] INFO: Scrape type for GU07540: 0
2026-03-28 21:08:17 [auto1.it] INFO: Found listing with ID: BW81707
2026-03-28 21:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW81707%27 HTTP/1.1" 200 None
2026-03-28 21:08:18 [auto1.it] INFO: Scrape type for BW81707: 0
2026-03-28 21:08:18 [auto1.it] INFO: Found listing with ID: MJ56294
2026-03-28 21:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ56294%27 HTTP/1.1" 200 None
2026-03-28 21:08:18 [auto1.it] INFO: Scrape type for MJ56294: 0
2026-03-28 21:08:18 [auto1.it] INFO: Found listing with ID: ND60676
2026-03-28 21:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ND60676%27 HTTP/1.1" 200 None
2026-03-28 21:08:18 [auto1.it] INFO: Scrape type for ND60676: 0
2026-03-28 21:08:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:08:19 [auto1.it] INFO: Channel: 24h | Page: 50 | totalHits: 2224 | hits on page: 40
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: RD34551
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: MX89615
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: DC79577
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: DF10030
2026-03-28 21:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF10030%27 HTTP/1.1" 200 None
2026-03-28 21:08:19 [auto1.it] INFO: Scrape type for DF10030: 0
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: FJ19911
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: DP83591
2026-03-28 21:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP83591%27 HTTP/1.1" 200 None
2026-03-28 21:08:19 [auto1.it] INFO: Scrape type for DP83591: 0
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: RF53888
2026-03-28 21:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF53888%27 HTTP/1.1" 200 None
2026-03-28 21:08:19 [auto1.it] INFO: Scrape type for RF53888: 0
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: XC35499
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: KW13943
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: CK02940
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: NW63690
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: CR10860
2026-03-28 21:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR10860%27 HTTP/1.1" 200 None
2026-03-28 21:08:19 [auto1.it] INFO: Scrape type for CR10860: 0
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: PX02634
2026-03-28 21:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PX02634%27 HTTP/1.1" 200 None
2026-03-28 21:08:19 [auto1.it] INFO: Scrape type for PX02634: 0
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: RZ14942
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: NE68522
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: HB76167
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: LW42205
2026-03-28 21:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LW42205%27 HTTP/1.1" 200 None
2026-03-28 21:08:19 [auto1.it] INFO: Scrape type for LW42205: 0
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: YU39946
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: JX99167
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: PR01158
2026-03-28 21:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR01158%27 HTTP/1.1" 200 None
2026-03-28 21:08:19 [auto1.it] INFO: Scrape type for PR01158: 0
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: PB77964
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: LU04143
2026-03-28 21:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU04143%27 HTTP/1.1" 200 None
2026-03-28 21:08:19 [auto1.it] INFO: Scrape type for LU04143: 0
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: VX06371
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: XU75020
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: RT78827
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: ZX02617
2026-03-28 21:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX02617%27 HTTP/1.1" 200 None
2026-03-28 21:08:19 [auto1.it] INFO: Scrape type for ZX02617: 0
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: GF04401
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: LF71839
2026-03-28 21:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LF71839%27 HTTP/1.1" 200 None
2026-03-28 21:08:19 [auto1.it] INFO: Scrape type for LF71839: 0
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: KV81214
2026-03-28 21:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV81214%27 HTTP/1.1" 200 None
2026-03-28 21:08:19 [auto1.it] INFO: Scrape type for KV81214: 0
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: NZ66288
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: LC50167
2026-03-28 21:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC50167%27 HTTP/1.1" 200 None
2026-03-28 21:08:19 [auto1.it] INFO: Scrape type for LC50167: 0
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: RB44165
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: KG10642
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: VU78996
2026-03-28 21:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU78996%27 HTTP/1.1" 200 None
2026-03-28 21:08:19 [auto1.it] INFO: Scrape type for VU78996: 0
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: JC58161
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: NB09244
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: CG41342
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: XC50936
2026-03-28 21:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XC50936%27 HTTP/1.1" 200 None
2026-03-28 21:08:19 [auto1.it] INFO: Scrape type for XC50936: 0
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: PU47641
2026-03-28 21:08:19 [auto1.it] INFO: Found listing with ID: TV36442
2026-03-28 21:08:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:08:20 [auto1.it] INFO: Channel: 24h | Page: 51 | totalHits: 2224 | hits on page: 40
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: YG59194
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: NZ89280
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ89280%27 HTTP/1.1" 200 None
2026-03-28 21:08:20 [auto1.it] INFO: Scrape type for NZ89280: 0
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: DV86201
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DV86201%27 HTTP/1.1" 200 None
2026-03-28 21:08:20 [auto1.it] INFO: Scrape type for DV86201: 0
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: MR47105
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: CP63934
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP63934%27 HTTP/1.1" 200 None
2026-03-28 21:08:20 [auto1.it] INFO: Scrape type for CP63934: 0
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: WA70865
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: ZB75356
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: SM49398
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM49398%27 HTTP/1.1" 200 None
2026-03-28 21:08:20 [auto1.it] INFO: Scrape type for SM49398: 0
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: ND99251
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ND99251%27 HTTP/1.1" 200 None
2026-03-28 21:08:20 [auto1.it] INFO: Scrape type for ND99251: 0
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: RE64067
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: DE18860
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE18860%27 HTTP/1.1" 200 None
2026-03-28 21:08:20 [auto1.it] INFO: Scrape type for DE18860: 0
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: BM48711
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: NH24051
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NH24051%27 HTTP/1.1" 200 None
2026-03-28 21:08:20 [auto1.it] INFO: Scrape type for NH24051: 0
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: LU93439
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU93439%27 HTTP/1.1" 200 None
2026-03-28 21:08:20 [auto1.it] INFO: Scrape type for LU93439: 0
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: GC10643
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC10643%27 HTTP/1.1" 200 None
2026-03-28 21:08:20 [auto1.it] INFO: Scrape type for GC10643: 0
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: SZ93699
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SZ93699%27 HTTP/1.1" 200 None
2026-03-28 21:08:20 [auto1.it] INFO: Scrape type for SZ93699: 0
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: HD89174
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: LL57465
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: SD35651
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: VJ26511
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ26511%27 HTTP/1.1" 200 None
2026-03-28 21:08:20 [auto1.it] INFO: Scrape type for VJ26511: 0
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: UM38141
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UM38141%27 HTTP/1.1" 200 None
2026-03-28 21:08:20 [auto1.it] INFO: Scrape type for UM38141: 0
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: XE84016
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: LD34697
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD34697%27 HTTP/1.1" 200 None
2026-03-28 21:08:20 [auto1.it] INFO: Scrape type for LD34697: 0
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: NN91424
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: JP07987
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: ZM57231
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: KG93031
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: PK33610
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK33610%27 HTTP/1.1" 200 None
2026-03-28 21:08:20 [auto1.it] INFO: Scrape type for PK33610: 0
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: FL38609
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: PR73005
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR73005%27 HTTP/1.1" 200 None
2026-03-28 21:08:20 [auto1.it] INFO: Scrape type for PR73005: 0
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: AL33204
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL33204%27 HTTP/1.1" 200 None
2026-03-28 21:08:20 [auto1.it] INFO: Scrape type for AL33204: 0
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: VU45167
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU45167%27 HTTP/1.1" 200 None
2026-03-28 21:08:20 [auto1.it] INFO: Scrape type for VU45167: 0
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: YD14292
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD14292%27 HTTP/1.1" 200 None
2026-03-28 21:08:20 [auto1.it] INFO: Scrape type for YD14292: 0
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: HC79760
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HC79760%27 HTTP/1.1" 200 None
2026-03-28 21:08:20 [auto1.it] INFO: Scrape type for HC79760: 0
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: YJ65230
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: AY38539
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY38539%27 HTTP/1.1" 200 None
2026-03-28 21:08:20 [auto1.it] INFO: Scrape type for AY38539: 0
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: FN08703
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN08703%27 HTTP/1.1" 200 None
2026-03-28 21:08:20 [auto1.it] INFO: Scrape type for FN08703: 0
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: DK59825
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: SN64311
2026-03-28 21:08:20 [auto1.it] INFO: Found listing with ID: WA74903
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA74903%27 HTTP/1.1" 200 None
2026-03-28 21:08:20 [auto1.it] INFO: Scrape type for WA74903: 0
2026-03-28 21:08:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:08:21 [auto1.it] INFO: Channel: 24h | Page: 52 | totalHits: 2224 | hits on page: 40
2026-03-28 21:08:21 [auto1.it] INFO: Found listing with ID: NV36405
2026-03-28 21:08:21 [auto1.it] INFO: Found listing with ID: EY62872
2026-03-28 21:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY62872%27 HTTP/1.1" 200 None
2026-03-28 21:08:21 [auto1.it] INFO: Scrape type for EY62872: 0
2026-03-28 21:08:21 [auto1.it] INFO: Found listing with ID: RX99129
2026-03-28 21:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX99129%27 HTTP/1.1" 200 None
2026-03-28 21:08:21 [auto1.it] INFO: Scrape type for RX99129: 0
2026-03-28 21:08:21 [auto1.it] INFO: Found listing with ID: MT10040
2026-03-28 21:08:21 [auto1.it] INFO: Found listing with ID: DE88474
2026-03-28 21:08:21 [auto1.it] INFO: Found listing with ID: FC40925
2026-03-28 21:08:21 [auto1.it] INFO: Found listing with ID: LB90809
2026-03-28 21:08:21 [auto1.it] INFO: Found listing with ID: EU57494
2026-03-28 21:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EU57494%27 HTTP/1.1" 200 None
2026-03-28 21:08:21 [auto1.it] INFO: Scrape type for EU57494: 0
2026-03-28 21:08:21 [auto1.it] INFO: Found listing with ID: EG76959
2026-03-28 21:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG76959%27 HTTP/1.1" 200 None
2026-03-28 21:08:21 [auto1.it] INFO: Scrape type for EG76959: 0
2026-03-28 21:08:21 [auto1.it] INFO: Found listing with ID: BV97003
2026-03-28 21:08:21 [auto1.it] INFO: Found listing with ID: EW38815
2026-03-28 21:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW38815%27 HTTP/1.1" 200 None
2026-03-28 21:08:21 [auto1.it] INFO: Scrape type for EW38815: 0
2026-03-28 21:08:21 [auto1.it] INFO: Found listing with ID: RC51898
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC51898%27 HTTP/1.1" 200 None
2026-03-28 21:08:22 [auto1.it] INFO: Scrape type for RC51898: 0
2026-03-28 21:08:22 [auto1.it] INFO: Found listing with ID: RL93891
2026-03-28 21:08:22 [auto1.it] INFO: Found listing with ID: EX32240
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EX32240%27 HTTP/1.1" 200 None
2026-03-28 21:08:22 [auto1.it] INFO: Scrape type for EX32240: 0
2026-03-28 21:08:22 [auto1.it] INFO: Found listing with ID: SC52671
2026-03-28 21:08:22 [auto1.it] INFO: Found listing with ID: ZD86423
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD86423%27 HTTP/1.1" 200 None
2026-03-28 21:08:22 [auto1.it] INFO: Scrape type for ZD86423: 0
2026-03-28 21:08:22 [auto1.it] INFO: Found listing with ID: FJ00600
2026-03-28 21:08:22 [auto1.it] INFO: Found listing with ID: GD51545
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD51545%27 HTTP/1.1" 200 None
2026-03-28 21:08:22 [auto1.it] INFO: Scrape type for GD51545: 0
2026-03-28 21:08:22 [auto1.it] INFO: Found listing with ID: HC77212
2026-03-28 21:08:22 [auto1.it] INFO: Found listing with ID: UD61440
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD61440%27 HTTP/1.1" 200 None
2026-03-28 21:08:22 [auto1.it] INFO: Scrape type for UD61440: 0
2026-03-28 21:08:22 [auto1.it] INFO: Found listing with ID: EP46313
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP46313%27 HTTP/1.1" 200 None
2026-03-28 21:08:22 [auto1.it] INFO: Scrape type for EP46313: 0
2026-03-28 21:08:22 [auto1.it] INFO: Found listing with ID: NB70789
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB70789%27 HTTP/1.1" 200 None
2026-03-28 21:08:22 [auto1.it] INFO: Scrape type for NB70789: 0
2026-03-28 21:08:22 [auto1.it] INFO: Found listing with ID: ZF56836
2026-03-28 21:08:22 [auto1.it] INFO: Found listing with ID: LS68308
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS68308%27 HTTP/1.1" 200 None
2026-03-28 21:08:22 [auto1.it] INFO: Scrape type for LS68308: 0
2026-03-28 21:08:22 [auto1.it] INFO: Found listing with ID: LX14349
2026-03-28 21:08:22 [auto1.it] INFO: Found listing with ID: HU17700
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU17700%27 HTTP/1.1" 200 None
2026-03-28 21:08:22 [auto1.it] INFO: Scrape type for HU17700: 0
2026-03-28 21:08:22 [auto1.it] INFO: Found listing with ID: XB86450
2026-03-28 21:08:22 [auto1.it] INFO: Found listing with ID: BC13106
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BC13106%27 HTTP/1.1" 200 None
2026-03-28 21:08:22 [auto1.it] INFO: Scrape type for BC13106: 0
2026-03-28 21:08:22 [auto1.it] INFO: Found listing with ID: SS75136
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS75136%27 HTTP/1.1" 200 None
2026-03-28 21:08:22 [auto1.it] INFO: Scrape type for SS75136: 0
2026-03-28 21:08:22 [auto1.it] INFO: Found listing with ID: TZ08821
2026-03-28 21:08:22 [auto1.it] INFO: Found listing with ID: FW12151
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FW12151%27 HTTP/1.1" 200 None
2026-03-28 21:08:22 [auto1.it] INFO: Scrape type for FW12151: 0
2026-03-28 21:08:22 [auto1.it] INFO: Found listing with ID: SD66994
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD66994%27 HTTP/1.1" 200 None
2026-03-28 21:08:22 [auto1.it] INFO: Scrape type for SD66994: 0
2026-03-28 21:08:22 [auto1.it] INFO: Found listing with ID: LB50046
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB50046%27 HTTP/1.1" 200 None
2026-03-28 21:08:22 [auto1.it] INFO: Scrape type for LB50046: 0
2026-03-28 21:08:22 [auto1.it] INFO: Found listing with ID: NL74097
2026-03-28 21:08:22 [auto1.it] INFO: Found listing with ID: ME27860
2026-03-28 21:08:22 [auto1.it] INFO: Found listing with ID: MX93098
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX93098%27 HTTP/1.1" 200 None
2026-03-28 21:08:22 [auto1.it] INFO: Scrape type for MX93098: 0
2026-03-28 21:08:22 [auto1.it] INFO: Found listing with ID: CL75380
2026-03-28 21:08:22 [auto1.it] INFO: Found listing with ID: VK29965
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK29965%27 HTTP/1.1" 200 None
2026-03-28 21:08:22 [auto1.it] INFO: Scrape type for VK29965: 0
2026-03-28 21:08:22 [auto1.it] INFO: Found listing with ID: WG00273
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG00273%27 HTTP/1.1" 200 None
2026-03-28 21:08:22 [auto1.it] INFO: Scrape type for WG00273: 0
2026-03-28 21:08:22 [auto1.it] INFO: Found listing with ID: BX84836
2026-03-28 21:08:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:08:23 [auto1.it] INFO: Channel: 24h | Page: 53 | totalHits: 2224 | hits on page: 40
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: ZH45027
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: CD24058
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: VB56015
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB56015%27 HTTP/1.1" 200 None
2026-03-28 21:08:23 [auto1.it] INFO: Scrape type for VB56015: 0
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: TV81460
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: RK78436
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RK78436%27 HTTP/1.1" 200 None
2026-03-28 21:08:23 [auto1.it] INFO: Scrape type for RK78436: 0
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: SX60727
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: SF25356
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: PB64949
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: HW36660
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW36660%27 HTTP/1.1" 200 None
2026-03-28 21:08:23 [auto1.it] INFO: Scrape type for HW36660: 0
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: HR61031
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HR61031%27 HTTP/1.1" 200 None
2026-03-28 21:08:23 [auto1.it] INFO: Scrape type for HR61031: 0
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: GX37056
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX37056%27 HTTP/1.1" 200 None
2026-03-28 21:08:23 [auto1.it] INFO: Scrape type for GX37056: 0
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: RU00933
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: SP24974
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP24974%27 HTTP/1.1" 200 None
2026-03-28 21:08:23 [auto1.it] INFO: Scrape type for SP24974: 0
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: WU48756
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WU48756%27 HTTP/1.1" 200 None
2026-03-28 21:08:23 [auto1.it] INFO: Scrape type for WU48756: 0
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: PR17884
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: XP65023
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: FV28373
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FV28373%27 HTTP/1.1" 200 None
2026-03-28 21:08:23 [auto1.it] INFO: Scrape type for FV28373: 0
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: WM91137
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM91137%27 HTTP/1.1" 200 None
2026-03-28 21:08:23 [auto1.it] INFO: Scrape type for WM91137: 0
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: BU89130
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BU89130%27 HTTP/1.1" 200 None
2026-03-28 21:08:23 [auto1.it] INFO: Scrape type for BU89130: 0
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: MR74044
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR74044%27 HTTP/1.1" 200 None
2026-03-28 21:08:23 [auto1.it] INFO: Scrape type for MR74044: 0
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: JB83443
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JB83443%27 HTTP/1.1" 200 None
2026-03-28 21:08:23 [auto1.it] INFO: Scrape type for JB83443: 0
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: PB47164
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: RU74019
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU74019%27 HTTP/1.1" 200 None
2026-03-28 21:08:23 [auto1.it] INFO: Scrape type for RU74019: 0
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: GT62268
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: NY06096
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NY06096%27 HTTP/1.1" 200 None
2026-03-28 21:08:23 [auto1.it] INFO: Scrape type for NY06096: 0
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: DD11193
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DD11193%27 HTTP/1.1" 200 None
2026-03-28 21:08:23 [auto1.it] INFO: Scrape type for DD11193: 0
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: TU55073
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU55073%27 HTTP/1.1" 200 None
2026-03-28 21:08:23 [auto1.it] INFO: Scrape type for TU55073: 0
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: JC52693
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC52693%27 HTTP/1.1" 200 None
2026-03-28 21:08:23 [auto1.it] INFO: Scrape type for JC52693: 0
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: BA37529
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BA37529%27 HTTP/1.1" 200 None
2026-03-28 21:08:23 [auto1.it] INFO: Scrape type for BA37529: 0
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: PR63683
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR63683%27 HTTP/1.1" 200 None
2026-03-28 21:08:23 [auto1.it] INFO: Scrape type for PR63683: 0
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: KC74563
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC74563%27 HTTP/1.1" 200 None
2026-03-28 21:08:23 [auto1.it] INFO: Scrape type for KC74563: 0
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: JD73354
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: MB22824
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB22824%27 HTTP/1.1" 200 None
2026-03-28 21:08:23 [auto1.it] INFO: Scrape type for MB22824: 0
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: NW35507
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NW35507%27 HTTP/1.1" 200 None
2026-03-28 21:08:23 [auto1.it] INFO: Scrape type for NW35507: 0
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: AG64342
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AG64342%27 HTTP/1.1" 200 None
2026-03-28 21:08:23 [auto1.it] INFO: Scrape type for AG64342: 0
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: RC92896
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC92896%27 HTTP/1.1" 200 None
2026-03-28 21:08:23 [auto1.it] INFO: Scrape type for RC92896: 0
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: WK68121
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK68121%27 HTTP/1.1" 200 None
2026-03-28 21:08:23 [auto1.it] INFO: Scrape type for WK68121: 0
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: MM70792
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MM70792%27 HTTP/1.1" 200 None
2026-03-28 21:08:23 [auto1.it] INFO: Scrape type for MM70792: 0
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: RF74009
2026-03-28 21:08:23 [auto1.it] INFO: Found listing with ID: FD11952
2026-03-28 21:08:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:08:25 [auto1.it] INFO: Channel: 24h | Page: 54 | totalHits: 2224 | hits on page: 40
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: VP67579
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP67579%27 HTTP/1.1" 200 None
2026-03-28 21:08:25 [auto1.it] INFO: Scrape type for VP67579: 0
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: VM60926
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM60926%27 HTTP/1.1" 200 None
2026-03-28 21:08:25 [auto1.it] INFO: Scrape type for VM60926: 0
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: RY72509
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY72509%27 HTTP/1.1" 200 None
2026-03-28 21:08:25 [auto1.it] INFO: Scrape type for RY72509: 0
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: UE94474
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UE94474%27 HTTP/1.1" 200 None
2026-03-28 21:08:25 [auto1.it] INFO: Scrape type for UE94474: 0
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: LG11591
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: UD99211
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: SX47374
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: AP90035
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP90035%27 HTTP/1.1" 200 None
2026-03-28 21:08:25 [auto1.it] INFO: Scrape type for AP90035: 0
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: NS10029
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: BY89134
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY89134%27 HTTP/1.1" 200 None
2026-03-28 21:08:25 [auto1.it] INFO: Scrape type for BY89134: 0
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: TW88152
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: MU21056
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU21056%27 HTTP/1.1" 200 None
2026-03-28 21:08:25 [auto1.it] INFO: Scrape type for MU21056: 0
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: BG29864
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: XE56181
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XE56181%27 HTTP/1.1" 200 None
2026-03-28 21:08:25 [auto1.it] INFO: Scrape type for XE56181: 0
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: WY26414
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: CP34925
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CP34925%27 HTTP/1.1" 200 None
2026-03-28 21:08:25 [auto1.it] INFO: Scrape type for CP34925: 0
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: UB84582
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB84582%27 HTTP/1.1" 200 None
2026-03-28 21:08:25 [auto1.it] INFO: Scrape type for UB84582: 0
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: HY41860
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: CB28979
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB28979%27 HTTP/1.1" 200 None
2026-03-28 21:08:25 [auto1.it] INFO: Scrape type for CB28979: 0
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: FD69176
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: RG05236
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG05236%27 HTTP/1.1" 200 None
2026-03-28 21:08:25 [auto1.it] INFO: Scrape type for RG05236: 0
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: MN63848
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MN63848%27 HTTP/1.1" 200 None
2026-03-28 21:08:25 [auto1.it] INFO: Scrape type for MN63848: 0
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: GC15950
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC15950%27 HTTP/1.1" 200 None
2026-03-28 21:08:25 [auto1.it] INFO: Scrape type for GC15950: 0
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: ZU87038
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: YR71782
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR71782%27 HTTP/1.1" 200 None
2026-03-28 21:08:25 [auto1.it] INFO: Scrape type for YR71782: 0
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: RX70685
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX70685%27 HTTP/1.1" 200 None
2026-03-28 21:08:25 [auto1.it] INFO: Scrape type for RX70685: 0
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: ZG33148
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: JP42061
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP42061%27 HTTP/1.1" 200 None
2026-03-28 21:08:25 [auto1.it] INFO: Scrape type for JP42061: 0
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: PR59695
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR59695%27 HTTP/1.1" 200 None
2026-03-28 21:08:25 [auto1.it] INFO: Scrape type for PR59695: 0
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: YC40082
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YC40082%27 HTTP/1.1" 200 None
2026-03-28 21:08:25 [auto1.it] INFO: Scrape type for YC40082: 0
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: AL09653
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL09653%27 HTTP/1.1" 200 None
2026-03-28 21:08:25 [auto1.it] INFO: Scrape type for AL09653: 0
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: DK55043
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK55043%27 HTTP/1.1" 200 None
2026-03-28 21:08:25 [auto1.it] INFO: Scrape type for DK55043: 0
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: AG82147
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: RG79014
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: NU26591
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NU26591%27 HTTP/1.1" 200 None
2026-03-28 21:08:25 [auto1.it] INFO: Scrape type for NU26591: 0
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: UB42424
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB42424%27 HTTP/1.1" 200 None
2026-03-28 21:08:25 [auto1.it] INFO: Scrape type for UB42424: 0
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: RV63380
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV63380%27 HTTP/1.1" 200 None
2026-03-28 21:08:25 [auto1.it] INFO: Scrape type for RV63380: 0
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: JE70672
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE70672%27 HTTP/1.1" 200 None
2026-03-28 21:08:25 [auto1.it] INFO: Scrape type for JE70672: 0
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: KL44785
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL44785%27 HTTP/1.1" 200 None
2026-03-28 21:08:25 [auto1.it] INFO: Scrape type for KL44785: 0
2026-03-28 21:08:25 [auto1.it] INFO: Found listing with ID: TU59167
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU59167%27 HTTP/1.1" 200 None
2026-03-28 21:08:25 [auto1.it] INFO: Scrape type for TU59167: 0
2026-03-28 21:08:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:08:26 [auto1.it] INFO: Channel: 24h | Page: 55 | totalHits: 2224 | hits on page: 40
2026-03-28 21:08:26 [auto1.it] INFO: Found listing with ID: TD04886
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD04886%27 HTTP/1.1" 200 None
2026-03-28 21:08:26 [auto1.it] INFO: Scrape type for TD04886: 0
2026-03-28 21:08:26 [auto1.it] INFO: Found listing with ID: NK26905
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK26905%27 HTTP/1.1" 200 None
2026-03-28 21:08:26 [auto1.it] INFO: Scrape type for NK26905: 0
2026-03-28 21:08:26 [auto1.it] INFO: Found listing with ID: PL47981
2026-03-28 21:08:26 [auto1.it] INFO: Found listing with ID: EP64063
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EP64063%27 HTTP/1.1" 200 None
2026-03-28 21:08:26 [auto1.it] INFO: Scrape type for EP64063: 0
2026-03-28 21:08:26 [auto1.it] INFO: Found listing with ID: XS31843
2026-03-28 21:08:26 [auto1.it] INFO: Found listing with ID: DP98022
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP98022%27 HTTP/1.1" 200 None
2026-03-28 21:08:26 [auto1.it] INFO: Scrape type for DP98022: 0
2026-03-28 21:08:26 [auto1.it] INFO: Found listing with ID: TZ57511
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ57511%27 HTTP/1.1" 200 None
2026-03-28 21:08:26 [auto1.it] INFO: Scrape type for TZ57511: 0
2026-03-28 21:08:26 [auto1.it] INFO: Found listing with ID: XF75286
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF75286%27 HTTP/1.1" 200 None
2026-03-28 21:08:26 [auto1.it] INFO: Scrape type for XF75286: 0
2026-03-28 21:08:26 [auto1.it] INFO: Found listing with ID: MN96094
2026-03-28 21:08:26 [auto1.it] INFO: Found listing with ID: YD21144
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YD21144%27 HTTP/1.1" 200 None
2026-03-28 21:08:26 [auto1.it] INFO: Scrape type for YD21144: 0
2026-03-28 21:08:26 [auto1.it] INFO: Found listing with ID: RT57270
2026-03-28 21:08:26 [auto1.it] INFO: Found listing with ID: JC99655
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JC99655%27 HTTP/1.1" 200 None
2026-03-28 21:08:26 [auto1.it] INFO: Scrape type for JC99655: 0
2026-03-28 21:08:26 [auto1.it] INFO: Found listing with ID: YN59096
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YN59096%27 HTTP/1.1" 200 None
2026-03-28 21:08:26 [auto1.it] INFO: Scrape type for YN59096: 0
2026-03-28 21:08:26 [auto1.it] INFO: Found listing with ID: PC10641
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PC10641%27 HTTP/1.1" 200 None
2026-03-28 21:08:26 [auto1.it] INFO: Scrape type for PC10641: 0
2026-03-28 21:08:26 [auto1.it] INFO: Found listing with ID: MH04778
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MH04778%27 HTTP/1.1" 200 None
2026-03-28 21:08:26 [auto1.it] INFO: Scrape type for MH04778: 0
2026-03-28 21:08:26 [auto1.it] INFO: Found listing with ID: HG07035
2026-03-28 21:08:26 [auto1.it] INFO: Found listing with ID: RB57838
2026-03-28 21:08:26 [auto1.it] INFO: Found listing with ID: UW00940
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW00940%27 HTTP/1.1" 200 None
2026-03-28 21:08:26 [auto1.it] INFO: Scrape type for UW00940: 0
2026-03-28 21:08:26 [auto1.it] INFO: Found listing with ID: CR16346
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CR16346%27 HTTP/1.1" 200 None
2026-03-28 21:08:26 [auto1.it] INFO: Scrape type for CR16346: 0
2026-03-28 21:08:26 [auto1.it] INFO: Found listing with ID: PD21393
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD21393%27 HTTP/1.1" 200 None
2026-03-28 21:08:26 [auto1.it] INFO: Scrape type for PD21393: 0
2026-03-28 21:08:26 [auto1.it] INFO: Found listing with ID: AU50392
2026-03-28 21:08:26 [auto1.it] INFO: Found listing with ID: XK62729
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK62729%27 HTTP/1.1" 200 None
2026-03-28 21:08:26 [auto1.it] INFO: Scrape type for XK62729: 0
2026-03-28 21:08:26 [auto1.it] INFO: Found listing with ID: BD17279
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD17279%27 HTTP/1.1" 200 None
2026-03-28 21:08:26 [auto1.it] INFO: Scrape type for BD17279: 0
2026-03-28 21:08:26 [auto1.it] INFO: Found listing with ID: VV69855
2026-03-28 21:08:26 [auto1.it] INFO: Found listing with ID: WP22813
2026-03-28 21:08:26 [auto1.it] INFO: Found listing with ID: PZ74443
2026-03-28 21:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PZ74443%27 HTTP/1.1" 200 None
2026-03-28 21:08:27 [auto1.it] INFO: Scrape type for PZ74443: 0
2026-03-28 21:08:27 [auto1.it] INFO: Found listing with ID: DF91853
2026-03-28 21:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DF91853%27 HTTP/1.1" 200 None
2026-03-28 21:08:27 [auto1.it] INFO: Scrape type for DF91853: 0
2026-03-28 21:08:27 [auto1.it] INFO: Found listing with ID: KA05234
2026-03-28 21:08:27 [auto1.it] INFO: Found listing with ID: NA17081
2026-03-28 21:08:27 [auto1.it] INFO: Found listing with ID: XL36522
2026-03-28 21:08:27 [auto1.it] INFO: Found listing with ID: WJ93918
2026-03-28 21:08:27 [auto1.it] INFO: Found listing with ID: PW21371
2026-03-28 21:08:27 [auto1.it] INFO: Found listing with ID: TR54078
2026-03-28 21:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR54078%27 HTTP/1.1" 200 None
2026-03-28 21:08:27 [auto1.it] INFO: Scrape type for TR54078: 0
2026-03-28 21:08:27 [auto1.it] INFO: Found listing with ID: LG70821
2026-03-28 21:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG70821%27 HTTP/1.1" 200 None
2026-03-28 21:08:27 [auto1.it] INFO: Scrape type for LG70821: 0
2026-03-28 21:08:27 [auto1.it] INFO: Found listing with ID: TL02972
2026-03-28 21:08:27 [auto1.it] INFO: Found listing with ID: PD30072
2026-03-28 21:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD30072%27 HTTP/1.1" 200 None
2026-03-28 21:08:27 [auto1.it] INFO: Scrape type for PD30072: 0
2026-03-28 21:08:27 [auto1.it] INFO: Found listing with ID: PN93360
2026-03-28 21:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PN93360%27 HTTP/1.1" 200 None
2026-03-28 21:08:27 [auto1.it] INFO: Scrape type for PN93360: 0
2026-03-28 21:08:27 [auto1.it] INFO: Found listing with ID: WH30921
2026-03-28 21:08:27 [auto1.it] INFO: Found listing with ID: WC55302
2026-03-28 21:08:27 [auto1.it] INFO: Found listing with ID: GP46420
2026-03-28 21:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GP46420%27 HTTP/1.1" 200 None
2026-03-28 21:08:27 [auto1.it] INFO: Scrape type for GP46420: 0
2026-03-28 21:08:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:08:29 [auto1.it] INFO: Channel: 24h | Page: 56 | totalHits: 2224 | hits on page: 24
2026-03-28 21:08:29 [auto1.it] INFO: Found listing with ID: LD02725
2026-03-28 21:08:29 [auto1.it] INFO: Found listing with ID: SB80667
2026-03-28 21:08:29 [auto1.it] INFO: Found listing with ID: HW51602
2026-03-28 21:08:29 [auto1.it] INFO: Found listing with ID: DX75497
2026-03-28 21:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DX75497%27 HTTP/1.1" 200 None
2026-03-28 21:08:29 [auto1.it] INFO: Scrape type for DX75497: 0
2026-03-28 21:08:29 [auto1.it] INFO: Found listing with ID: KF97174
2026-03-28 21:08:29 [auto1.it] INFO: Found listing with ID: UT33269
2026-03-28 21:08:29 [auto1.it] INFO: Found listing with ID: GJ33186
2026-03-28 21:08:29 [auto1.it] INFO: Found listing with ID: CJ50775
2026-03-28 21:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CJ50775%27 HTTP/1.1" 200 None
2026-03-28 21:08:29 [auto1.it] INFO: Scrape type for CJ50775: 0
2026-03-28 21:08:29 [auto1.it] INFO: Found listing with ID: YB09690
2026-03-28 21:08:29 [auto1.it] INFO: Found listing with ID: UC99700
2026-03-28 21:08:29 [auto1.it] INFO: Found listing with ID: EG31110
2026-03-28 21:08:29 [auto1.it] INFO: Found listing with ID: SK62476
2026-03-28 21:08:29 [auto1.it] INFO: Found listing with ID: KR24813
2026-03-28 21:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR24813%27 HTTP/1.1" 200 None
2026-03-28 21:08:29 [auto1.it] INFO: Scrape type for KR24813: 0
2026-03-28 21:08:29 [auto1.it] INFO: Found listing with ID: WL53741
2026-03-28 21:08:29 [auto1.it] INFO: Found listing with ID: KK99486
2026-03-28 21:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK99486%27 HTTP/1.1" 200 None
2026-03-28 21:08:29 [auto1.it] INFO: Scrape type for KK99486: 0
2026-03-28 21:08:29 [auto1.it] INFO: Found listing with ID: XW14976
2026-03-28 21:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW14976%27 HTTP/1.1" 200 None
2026-03-28 21:08:29 [auto1.it] INFO: Scrape type for XW14976: 0
2026-03-28 21:08:29 [auto1.it] INFO: Found listing with ID: CV32353
2026-03-28 21:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV32353%27 HTTP/1.1" 200 None
2026-03-28 21:08:29 [auto1.it] INFO: Scrape type for CV32353: 0
2026-03-28 21:08:29 [auto1.it] INFO: Found listing with ID: RB84694
2026-03-28 21:08:29 [auto1.it] INFO: Found listing with ID: YE49798
2026-03-28 21:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE49798%27 HTTP/1.1" 200 None
2026-03-28 21:08:29 [auto1.it] INFO: Scrape type for YE49798: 0
2026-03-28 21:08:29 [auto1.it] INFO: Found listing with ID: DJ31826
2026-03-28 21:08:29 [auto1.it] INFO: Found listing with ID: UL30423
2026-03-28 21:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL30423%27 HTTP/1.1" 200 None
2026-03-28 21:08:29 [auto1.it] INFO: Scrape type for UL30423: 0
2026-03-28 21:08:29 [auto1.it] INFO: Found listing with ID: MT45417
2026-03-28 21:08:29 [auto1.it] INFO: Found listing with ID: FV07755
2026-03-28 21:08:29 [auto1.it] INFO: Found listing with ID: SW75734
2026-03-28 21:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 21:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW75734%27 HTTP/1.1" 200 None
2026-03-28 21:08:29 [auto1.it] INFO: Scrape type for SW75734: 0
2026-03-28 21:08:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 21:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 21:08:30 [auto1.it] INFO: Channel: 24h | Page: 57 | totalHits: 2224 | hits on page: 0
2026-03-28 21:08:30 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 21:08:30 [auto1.it] INFO: auto1.it Batch config: batch 2/2
2026-03-28 21:08:30 [auto1.it] INFO: auto1.it Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 190, <ScrapeType.BATCH_SKIPPED: 5>: 154}
2026-03-28 21:08:30 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (170 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.it/task_23_2026-03-28T21_05_00.jl
2026-03-28 21:08:30 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 755969,
'downloader/request_count': 390,
'downloader/request_method_count/GET': 331,
'downloader/request_method_count/POST': 59,
'downloader/response_bytes': 54902716,
'downloader/response_count': 390,
'downloader/response_status_count/200': 390,
'dupefilter/filtered': 12,
'elapsed_time_seconds': 205.148028,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 28, 21, 8, 30, 345457, tzinfo=datetime.timezone.utc),
'item_scraped_count': 170,
'log_count/DEBUG': 6124,
'log_count/INFO': 6699,
'memusage/max': 203857920,
'memusage/startup': 150016000,
'photo_download_count': 195,
'request_depth_max': 60,
'response_received_count': 195,
'scheduler/dequeued': 390,
'scheduler/dequeued/memory': 390,
'scheduler/enqueued': 390,
'scheduler/enqueued/memory': 390,
'scrape_type/batch_skipped': 1118,
'scrape_type/new': 67,
'scrape_type/price_update': 103,
'scrape_type/skipped': 964,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 195,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 3.2084637819837103,
'scrapy-zyte-api/mean_response_seconds': 3.259936397897605,
'scrapy-zyte-api/processed': 195,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 195,
'scrapy-zyte-api/request_args/experimental.requestCookies': 194,
'scrapy-zyte-api/request_args/experimental.responseCookies': 195,
'scrapy-zyte-api/request_args/httpRequestBody': 59,
'scrapy-zyte-api/request_args/httpRequestMethod': 59,
'scrapy-zyte-api/request_args/httpResponseBody': 195,
'scrapy-zyte-api/request_args/httpResponseHeaders': 195,
'scrapy-zyte-api/request_args/sessionContext': 195,
'scrapy-zyte-api/request_args/url': 195,
'scrapy-zyte-api/status_codes/200': 195,
'scrapy-zyte-api/success': 195,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'source/items_encountered': 2264,
'source/total_available': 2224,
'start_time': datetime.datetime(2026, 3, 28, 21, 5, 5, 197429, tzinfo=datetime.timezone.utc)}
2026-03-28 21:08:30 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 21:08:30 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f2b8592a790>
2026-03-28 21:08:30 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f2b85a7c850>